2015/04/24 12:57:50 (32194) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/24 13:02:16 (32318) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:02:51 (32348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/24 13:02:51 (32348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/24 13:02:51 (32348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/24 13:03:10 (32353) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:05:58 (32360) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:06:20 (32370) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:07:52 (32392) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/24 13:07:52 (32392) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/24 13:07:52 (32392) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/24 13:12:42 (32557) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:12:44 (32559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:12:53 (32568) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/24 13:12:53 (32568) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/24 13:12:53 (32568) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/24 13:15:29 (32576) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:16:10 (32586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:17:54 (32596) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/24 13:17:54 (32596) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/24 13:17:54 (32596) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/24 13:22:55 (32628) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/24 13:22:55 (32628) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/24 13:22:55 (32628) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/24 13:23:18 (32670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:23:34 (32679) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:25:24 (32689) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:25:28 (32695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:27:56 (32703) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/24 13:27:56 (32703) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/24 13:27:56 (32703) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/24 13:32:17 (32762) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:32:57 (303) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/24 13:32:57 (303) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/24 13:32:57 (303) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/24 13:34:24 (330) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:34:54 (335) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:35:39 (346) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:37:58 (369) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/24 13:37:58 (369) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/24 13:37:58 (369) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/24 13:42:18 (493) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:43:00 (502) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/24 13:43:00 (502) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/24 13:43:00 (502) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/24 13:44:04 (559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:45:31 (566) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:46:34 (576) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:48:00 (583) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/24 13:48:00 (583) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/24 13:48:00 (583) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/24 13:52:22 (632) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:53:01 (641) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/24 13:53:01 (641) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/24 13:53:01 (641) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/24 13:53:54 (665) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:54:33 (674) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:56:32 (685) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 13:58:02 (692) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/24 13:58:02 (692) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/24 13:58:02 (692) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/24 14:02:00 (806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:03:03 (838) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/24 14:03:03 (838) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/24 14:03:03 (838) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/24 14:03:16 (840) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:04:44 (849) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:07:12 (861) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:08:04 (869) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/24 14:08:04 (869) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/24 14:08:04 (869) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/24 14:11:26 (956) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:12:53 (1023) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:13:05 (1026) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/24 14:13:05 (1026) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/24 14:13:05 (1026) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/24 14:14:17 (1036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:16:51 (1082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:18:06 (1089) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/24 14:18:06 (1089) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/24 14:18:06 (1089) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/24 14:21:52 (1142) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:22:49 (1179) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:23:07 (1181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/24 14:23:07 (1181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/24 14:23:07 (1181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/24 14:24:59 (1190) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:27:07 (1202) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:28:08 (1209) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/24 14:28:08 (1209) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/24 14:28:08 (1209) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/24 14:32:20 (1266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:33:09 (1297) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:33:10 (1299) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/24 14:33:10 (1299) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/24 14:33:10 (1299) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/24 14:35:23 (1310) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:36:44 (1320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:38:11 (1327) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/24 14:38:11 (1327) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/24 14:38:11 (1327) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/24 14:41:59 (1424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:43:12 (1458) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/24 14:43:12 (1458) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/24 14:43:12 (1458) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/24 14:43:20 (1460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:45:06 (1537) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:46:49 (1580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:48:13 (1588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/24 14:48:13 (1588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/24 14:48:13 (1588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/24 14:51:03 (1631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:53:14 (1699) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/24 14:53:14 (1699) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/24 14:53:14 (1699) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/24 14:53:46 (1721) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:54:05 (1726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:57:09 (1740) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 14:58:16 (1805) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/24 14:58:16 (1805) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/24 14:58:16 (1805) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/24 15:01:39 (1951) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:03:16 (1982) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/24 15:03:16 (1982) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/24 15:03:16 (1982) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/24 15:03:18 (1983) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:04:22 (1989) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:07:19 (2004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:08:17 (2011) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/24 15:08:17 (2011) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/24 15:08:17 (2011) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/24 15:11:04 (2097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:13:18 (2145) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/24 15:13:18 (2145) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/24 15:13:18 (2145) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/24 15:13:26 (2146) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:13:43 (2151) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:18:08 (2252) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:18:19 (2260) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/24 15:18:19 (2260) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/24 15:18:19 (2260) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/24 15:20:18 (2287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:22:36 (2341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:23:03 (2347) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:23:20 (2354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/24 15:23:20 (2354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/24 15:23:20 (2354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/24 15:27:59 (2366) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:28:21 (2373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/24 15:28:21 (2373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/24 15:28:21 (2373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/24 15:29:30 (2395) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:33:06 (2456) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:33:06 (2455) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:33:22 (2464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/24 15:33:22 (2464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/24 15:33:22 (2464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/24 15:37:56 (2474) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:38:23 (2481) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/24 15:38:23 (2481) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/24 15:38:23 (2481) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/24 15:40:04 (2509) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:43:24 (2601) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:43:25 (2603) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/24 15:43:25 (2603) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/24 15:43:25 (2603) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/24 15:43:42 (2607) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:48:19 (2695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:48:26 (2701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/24 15:48:26 (2701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/24 15:48:26 (2701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/24 15:49:19 (2724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:52:26 (2778) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:53:15 (2784) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:53:27 (2791) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/24 15:53:27 (2791) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/24 15:53:27 (2791) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/24 15:58:08 (2802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 15:58:28 (2829) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/24 15:58:28 (2829) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/24 15:58:28 (2829) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/24 15:58:40 (2830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:02:32 (2951) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:03:29 (2954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/24 16:03:29 (2954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/24 16:03:29 (2954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/24 16:03:41 (2958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:08:30 (2995) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/24 16:08:30 (2995) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/24 16:08:30 (2995) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/24 16:08:38 (2996) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:08:42 (3002) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:12:22 (3097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:13:00 (3102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:13:31 (3109) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/24 16:13:31 (3109) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/24 16:13:31 (3109) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/24 16:18:00 (3181) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:18:02 (3187) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:18:32 (3197) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/24 16:18:32 (3197) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/24 16:18:32 (3197) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/24 16:21:57 (3277) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:23:24 (3287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:23:33 (3293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/24 16:23:33 (3293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/24 16:23:33 (3293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/24 16:27:58 (3332) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:28:09 (3338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:28:34 (3348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/24 16:28:34 (3348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/24 16:28:34 (3348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/24 16:31:15 (3376) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:33:35 (3404) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/24 16:33:35 (3404) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/24 16:33:35 (3404) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/24 16:34:20 (3409) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:37:18 (3439) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:38:36 (3450) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/24 16:38:36 (3450) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/24 16:38:36 (3450) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/24 16:38:58 (3454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:42:08 (3537) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:43:37 (3556) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/24 16:43:37 (3556) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/24 16:43:37 (3556) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/24 16:44:03 (3560) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:47:21 (3593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:48:38 (3639) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/24 16:48:38 (3639) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/24 16:48:38 (3639) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/24 16:49:50 (3646) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:51:45 (3714) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:53:39 (3721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/24 16:53:39 (3721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/24 16:53:39 (3721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/24 16:54:00 (3740) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:57:39 (3776) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 16:58:40 (3786) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/24 16:58:40 (3786) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/24 16:58:40 (3786) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/24 16:59:45 (3791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:00:42 (3875) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:03:41 (3917) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/24 17:03:41 (3917) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/24 17:03:41 (3917) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/24 17:04:58 (3925) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:06:48 (3953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:08:42 (3964) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/24 17:08:42 (3964) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/24 17:08:42 (3964) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/24 17:09:01 (3968) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:10:30 (4004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:13:43 (4067) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/24 17:13:43 (4067) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/24 17:13:43 (4067) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/24 17:13:59 (4073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:16:18 (4101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:18:44 (4115) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/24 17:18:44 (4115) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/24 17:18:44 (4115) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/24 17:19:19 (4175) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:19:32 (4182) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:23:45 (4247) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/24 17:23:45 (4247) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/24 17:23:45 (4247) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/24 17:24:50 (4257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:26:47 (4288) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:28:46 (4299) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/24 17:28:46 (4299) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/24 17:28:46 (4299) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/24 17:29:16 (4320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:30:07 (4334) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:33:47 (4368) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/24 17:33:47 (4368) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/24 17:33:47 (4368) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/24 17:34:30 (4373) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:36:05 (4403) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:38:48 (4415) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/24 17:38:48 (4415) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/24 17:38:48 (4415) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/24 17:39:36 (4438) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:40:50 (4451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:43:49 (4520) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/24 17:43:49 (4520) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/24 17:43:49 (4520) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/24 17:44:09 (4524) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:46:28 (4555) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:48:50 (4566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/24 17:48:50 (4566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/24 17:48:50 (4566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/24 17:49:46 (4591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:49:57 (4596) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:53:48 (4702) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:53:51 (4708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/24 17:53:51 (4708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/24 17:53:51 (4708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/24 17:56:21 (4735) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 17:58:52 (4747) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/24 17:58:52 (4747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/24 17:58:52 (4747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/24 17:59:40 (4769) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:00:01 (4821) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:03:53 (4877) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/24 18:03:53 (4877) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/24 18:03:53 (4877) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/24 18:04:43 (4885) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:06:50 (4913) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:08:54 (4924) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/24 18:08:54 (4924) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/24 18:08:54 (4924) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/24 18:10:10 (4956) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:10:19 (4962) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:13:55 (5027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/24 18:13:55 (5027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/24 18:13:55 (5027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/24 18:15:33 (5035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:16:35 (5062) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:18:56 (5076) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/24 18:18:56 (5076) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/24 18:18:56 (5076) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/24 18:19:36 (5081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:21:10 (5116) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:22:11 (5177) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:23:57 (5230) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/24 18:23:57 (5230) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/24 18:23:57 (5230) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/24 18:25:42 (5256) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:25:54 (5268) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:27:43 (5285) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:28:58 (5302) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/24 18:28:58 (5302) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/24 18:28:58 (5302) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/24 18:29:49 (5310) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:31:54 (5358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:33:59 (5365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/24 18:33:59 (5365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/24 18:33:59 (5365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/24 18:36:02 (5380) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:36:34 (5407) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:39:00 (5421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/24 18:39:00 (5421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/24 18:39:00 (5421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/24 18:39:03 (5422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:41:42 (5485) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:44:01 (5525) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/24 18:44:01 (5525) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/24 18:44:01 (5525) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/24 18:46:28 (5555) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:46:29 (5564) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:49:00 (5579) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:49:02 (5595) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/24 18:49:02 (5595) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/24 18:49:02 (5595) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/24 18:49:08 (5596) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:50:45 (5632) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:54:03 (5695) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/24 18:54:03 (5695) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/24 18:54:03 (5695) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/24 18:55:42 (5750) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:57:17 (5767) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:57:23 (5783) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:59:04 (5795) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/24 18:59:04 (5795) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/24 18:59:04 (5795) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/24 18:59:27 (5800) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 18:59:49 (5826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:04:05 (5933) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/24 19:04:05 (5933) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/24 19:04:05 (5933) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/24 19:05:09 (5955) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:06:57 (5969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:08:37 (5980) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:09:06 (5986) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/24 19:09:06 (5986) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/24 19:09:06 (5986) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/24 19:10:17 (6015) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:14:07 (6100) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/24 19:14:07 (6100) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/24 19:14:07 (6100) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/24 19:14:23 (6104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:16:32 (6119) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:18:44 (6133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:19:08 (6140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/24 19:19:08 (6140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/24 19:19:08 (6140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/24 19:19:58 (6227) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:24:09 (6388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/24 19:24:09 (6388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/24 19:24:09 (6388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/24 19:24:12 (6389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:26:07 (6437) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:28:48 (6449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:29:10 (6456) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/24 19:29:10 (6456) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/24 19:29:10 (6456) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/24 19:29:42 (6483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:34:11 (6514) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/24 19:34:11 (6514) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/24 19:34:11 (6514) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/24 19:34:53 (6559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:35:14 (6571) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:38:50 (6590) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:39:12 (6616) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:39:13 (6616) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 19:39:13 (6616) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 19:39:13 (6616) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 19:39:29 (6620) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:44:14 (6676) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/24 19:44:14 (6676) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/24 19:44:14 (6676) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/24 19:45:09 (6699) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:45:29 (6725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:48:51 (6761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:49:15 (6763) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:49:15 (6763) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 19:49:15 (6763) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 19:49:15 (6763) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 19:49:37 (6770) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:54:16 (6805) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/24 19:54:16 (6805) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/24 19:54:16 (6805) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/24 19:55:03 (6866) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:55:35 (6879) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:58:28 (6948) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:59:02 (6954) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:59:17 (6960) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 19:59:17 (6960) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 19:59:17 (6960) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 19:59:17 (6960) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 20:04:14 (7082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:04:18 (7093) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/24 20:04:18 (7093) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/24 20:04:18 (7093) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/24 20:06:20 (7101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:07:40 (7129) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:08:10 (7134) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:09:19 (7144) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/24 20:09:19 (7144) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/24 20:09:19 (7144) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/24 20:14:03 (7215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:14:20 (7224) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/24 20:14:20 (7224) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/24 20:14:20 (7224) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/24 20:16:29 (7269) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:16:44 (7278) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:17:35 (7284) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:19:21 (7291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/24 20:19:21 (7291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/24 20:19:21 (7291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/24 20:24:04 (7325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:24:22 (7334) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/24 20:24:22 (7334) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/24 20:24:22 (7334) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/24 20:26:38 (7416) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:27:18 (7430) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:27:28 (7436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:29:23 (7476) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:29:23 (7476) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 20:29:23 (7476) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 20:29:23 (7476) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 20:33:46 (7513) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:34:24 (7524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/24 20:34:24 (7524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/24 20:34:24 (7524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/24 20:36:26 (7551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:37:03 (7581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:37:24 (7587) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:39:25 (7592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:39:26 (7592) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 20:39:26 (7592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 20:39:26 (7592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 20:44:18 (7689) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:44:26 (7698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/24 20:44:26 (7698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/24 20:44:26 (7698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/24 20:46:00 (7704) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:46:24 (7730) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:46:57 (7738) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:49:27 (7747) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:49:27 (7747) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 20:49:27 (7747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 20:49:27 (7747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 20:54:28 (7782) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/24 20:54:28 (7782) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/24 20:54:28 (7782) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/24 20:55:11 (7804) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:56:27 (7817) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:56:54 (7830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:57:26 (7892) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:59:29 (7933) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 20:59:30 (7933) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 20:59:30 (7933) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 20:59:30 (7933) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 21:04:30 (8033) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/24 21:04:30 (8033) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/24 21:04:30 (8033) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/24 21:06:07 (8059) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:06:36 (8092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:06:57 (8101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:07:06 (8103) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:09:31 (8115) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/24 21:09:31 (8115) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/24 21:09:31 (8115) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/24 21:14:32 (8183) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/24 21:14:32 (8183) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/24 21:14:32 (8183) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/24 21:15:58 (8209) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:16:25 (8238) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:16:40 (8244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:17:31 (8257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:19:33 (8265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/24 21:19:33 (8265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/24 21:19:33 (8265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/24 21:24:34 (8296) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/24 21:24:34 (8296) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/24 21:24:34 (8296) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/24 21:25:46 (8341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:25:47 (8343) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:27:07 (8361) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:28:26 (8371) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:29:35 (8417) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/24 21:29:35 (8417) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/24 21:29:35 (8417) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/24 21:34:36 (8481) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/24 21:34:36 (8481) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/24 21:34:36 (8481) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/24 21:35:40 (8506) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:35:59 (8528) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:37:35 (8543) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:37:49 (8553) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:39:37 (8561) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/24 21:39:37 (8561) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/24 21:39:37 (8561) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/24 21:44:38 (8635) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/24 21:44:38 (8635) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/24 21:44:38 (8635) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/24 21:46:17 (8659) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:46:59 (8685) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:47:05 (8694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:47:48 (8705) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:49:39 (8713) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:49:39 (8713) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 21:49:39 (8713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 21:49:39 (8713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 21:54:40 (8748) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/24 21:54:40 (8748) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/24 21:54:40 (8748) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/24 21:56:13 (8797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:56:20 (8806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:57:42 (8813) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:58:02 (8823) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:59:41 (8869) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 21:59:41 (8869) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 21:59:41 (8869) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 21:59:41 (8869) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 22:04:42 (9001) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/24 22:04:42 (9001) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/24 22:04:42 (9001) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/24 22:06:29 (9046) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:06:41 (9056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:07:18 (9062) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:08:28 (9072) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:09:43 (9080) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/24 22:09:43 (9080) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/24 22:09:43 (9080) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/24 22:14:44 (9150) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/24 22:14:44 (9150) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/24 22:14:44 (9150) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/24 22:16:41 (9200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:16:46 (9209) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:17:34 (9214) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:19:13 (9225) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:19:46 (9232) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/24 22:19:46 (9232) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/24 22:19:46 (9232) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/24 22:24:46 (9267) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/24 22:24:46 (9267) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/24 22:24:46 (9267) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/24 22:26:27 (9312) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:26:38 (9321) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:28:25 (9331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:29:47 (9345) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/24 22:29:47 (9345) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/24 22:29:47 (9345) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/24 22:29:53 (9346) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:34:48 (9451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:34:48 (9451) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 22:34:48 (9451) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 22:34:48 (9451) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 22:36:23 (9496) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:36:36 (9498) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:37:25 (9511) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:39:41 (9525) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:39:49 (9531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/24 22:39:49 (9531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/24 22:39:49 (9531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/24 22:44:50 (9606) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:44:50 (9606) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 22:44:50 (9606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 22:44:50 (9606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 22:45:52 (9631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:46:26 (9653) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:46:59 (9666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:49:45 (9678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:49:51 (9687) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/24 22:49:51 (9687) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/24 22:49:51 (9687) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/24 22:54:52 (9768) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:54:52 (9768) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 22:54:52 (9768) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 22:54:52 (9768) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 22:56:03 (9798) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:56:08 (9800) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:56:38 (9826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:59:11 (9841) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 22:59:53 (9905) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/24 22:59:53 (9905) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/24 22:59:53 (9905) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/24 23:04:54 (10080) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/24 23:04:54 (10080) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/24 23:04:54 (10080) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/24 23:06:22 (10106) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:06:38 (10132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:06:41 (10135) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:08:13 (10148) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:09:55 (10156) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/24 23:09:55 (10156) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/24 23:09:55 (10156) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/24 23:14:56 (10212) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:14:56 (10212) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 23:14:56 (10212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 23:14:56 (10212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 23:15:28 (10255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:15:41 (10262) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:17:16 (10296) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:18:19 (10302) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:19:57 (10310) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/24 23:19:57 (10310) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/24 23:19:57 (10310) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/24 23:24:41 (10332) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:24:58 (10338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:24:58 (10338) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 23:24:58 (10338) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 23:24:58 (10338) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 23:25:23 (10364) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:27:12 (10413) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:29:15 (10420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:29:59 (10427) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/24 23:29:59 (10427) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/24 23:29:59 (10427) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/24 23:34:49 (10487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:35:00 (10493) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:35:01 (10493) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 23:35:01 (10493) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 23:35:01 (10493) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 23:35:36 (10551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:37:24 (10598) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:40:01 (10610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:40:02 (10616) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/24 23:40:02 (10616) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/24 23:40:02 (10616) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/24 23:45:04 (10669) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/24 23:45:04 (10669) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/24 23:45:04 (10669) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/24 23:45:50 (10676) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:46:19 (10718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:48:04 (10749) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:49:59 (10756) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:50:04 (10766) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/24 23:50:04 (10766) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/24 23:50:04 (10766) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/24 23:55:00 (10801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:55:05 (10807) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:55:05 (10807) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/24 23:55:05 (10807) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/24 23:55:05 (10807) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/24 23:56:05 (10846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:58:53 (10879) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/24 23:59:31 (10884) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:00:06 (10944) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/25 00:00:06 (10944) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/25 00:00:06 (10944) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/25 00:05:07 (11014) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:05:07 (11014) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/25 00:05:07 (11014) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/25 00:05:07 (11014) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/25 00:05:46 (11043) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:05:58 (11049) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:08:06 (11128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:10:08 (11136) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/25 00:10:08 (11136) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/25 00:10:08 (11136) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/25 00:10:20 (11140) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:15:09 (11219) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:15:09 (11219) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/25 00:15:09 (11219) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/25 00:15:09 (11219) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/25 00:15:18 (11222) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:15:53 (11235) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:17:09 (11280) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:20:10 (11293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/25 00:20:10 (11293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/25 00:20:10 (11293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/25 00:20:12 (11294) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:25:11 (11323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:25:11 (11323) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/25 00:25:11 (11323) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/25 00:25:11 (11323) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/25 00:25:23 (11326) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:25:46 (11366) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:25:50 (11395) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:26:13 (11420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:26:26 (11422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:30:12 (11450) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:30:13 (11456) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/25 00:30:13 (11456) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/25 00:30:13 (11456) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/25 00:34:41 (11473) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:35:14 (11490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:35:14 (11490) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/25 00:35:14 (11490) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/25 00:35:14 (11490) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/25 00:35:45 (11585) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:36:00 (11594) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:36:29 (11602) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:37:53 (11652) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:40:15 (11678) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/25 00:40:15 (11678) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/25 00:40:15 (11678) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/25 00:40:23 (11679) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:45:16 (11759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/25 00:45:16 (11759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/25 00:45:16 (11759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/25 00:45:31 (11764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:46:31 (11810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:47:10 (11816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:49:48 (11828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:50:17 (11838) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/25 00:50:17 (11838) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/25 00:50:17 (11838) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/25 00:54:55 (11877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:55:18 (11886) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/25 00:55:18 (11886) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/25 00:55:18 (11886) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/25 00:55:50 (11909) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:58:02 (11931) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 00:59:22 (11943) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:00:19 (12003) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/25 01:00:19 (12003) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/25 01:00:19 (12003) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/25 01:04:09 (12059) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:05:24 (12130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/25 01:05:24 (12130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/25 01:05:24 (12130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/25 01:05:46 (12232) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:05:53 (12235) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:06:24 (12285) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:06:38 (12327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:08:08 (12344) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:10:25 (12413) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/25 01:10:25 (12413) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/25 01:10:25 (12413) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/25 01:10:32 (12414) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:14:59 (12498) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:15:16 (12508) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:15:26 (12510) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/25 01:15:26 (12510) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/25 01:15:26 (12510) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/25 01:15:38 (12521) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:17:08 (12567) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:20:27 (12588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/25 01:20:27 (12588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/25 01:20:27 (12588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/25 01:20:29 (12589) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:25:27 (12621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:25:28 (12627) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/25 01:25:28 (12627) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/25 01:25:28 (12627) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/25 01:26:05 (12651) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:26:30 (12673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:27:51 (12701) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:30:07 (12720) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:30:29 (12736) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/25 01:30:29 (12736) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/25 01:30:29 (12736) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/25 01:34:48 (12747) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:35:31 (12754) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/25 01:35:31 (12754) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/25 01:35:31 (12754) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/25 01:36:15 (12794) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:36:45 (12801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:38:04 (12869) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:40:31 (12924) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/25 01:40:31 (12924) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/25 01:40:31 (12924) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/25 01:43:57 (12957) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:45:32 (13006) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/25 01:45:32 (13006) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/25 01:45:32 (13006) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/25 01:45:50 (13008) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:47:18 (13052) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:47:29 (13061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:50:33 (13074) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/25 01:50:33 (13074) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/25 01:50:33 (13074) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/25 01:53:41 (13081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:55:11 (13113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:55:34 (13117) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/25 01:55:34 (13117) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/25 01:55:34 (13117) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/25 01:57:24 (13160) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 01:57:33 (13166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:00:35 (13237) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/25 02:00:35 (13237) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/25 02:00:35 (13237) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/25 02:03:54 (13267) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:05:36 (13299) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/25 02:05:36 (13299) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/25 02:05:36 (13299) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/25 02:05:47 (13300) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:07:41 (13344) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:07:56 (13357) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:10:37 (13411) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/25 02:10:37 (13411) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/25 02:10:37 (13411) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/25 02:13:50 (13454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:15:01 (13526) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:15:38 (13532) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/25 02:15:38 (13532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/25 02:15:38 (13532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/25 02:17:04 (13577) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:17:08 (13583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:20:39 (13599) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/25 02:20:39 (13599) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/25 02:20:39 (13599) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/25 02:23:27 (13606) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:25:29 (13638) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:25:40 (13640) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/25 02:25:40 (13640) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/25 02:25:40 (13640) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/25 02:26:09 (13665) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:27:44 (13695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:30:41 (13769) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/25 02:30:41 (13769) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/25 02:30:41 (13769) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/25 02:32:38 (13775) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:35:42 (13791) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/25 02:35:42 (13791) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/25 02:35:42 (13791) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/25 02:36:06 (13833) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:36:07 (13842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:38:06 (13871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:40:43 (13920) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/25 02:40:43 (13920) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/25 02:40:43 (13920) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/25 02:42:32 (13962) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:45:44 (14037) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/25 02:45:44 (14037) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/25 02:45:44 (14037) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/25 02:45:52 (14039) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:46:47 (14068) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:47:42 (14074) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:50:45 (14105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/25 02:50:45 (14105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/25 02:50:45 (14105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/25 02:52:33 (14111) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:55:46 (14144) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/25 02:55:46 (14144) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/25 02:55:46 (14144) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/25 02:56:06 (14168) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:56:07 (14177) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 02:58:31 (14202) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:00:47 (14265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/25 03:00:47 (14265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/25 03:00:47 (14265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/25 03:02:25 (14292) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:05:49 (14324) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:05:50 (14326) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/25 03:05:50 (14326) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/25 03:05:50 (14326) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/25 03:06:32 (14350) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:07:36 (14363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:10:51 (14395) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/25 03:10:51 (14395) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/25 03:10:51 (14395) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/25 03:12:10 (14443) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:15:52 (14540) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/25 03:15:52 (14540) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/25 03:15:52 (14540) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/25 03:16:00 (14542) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:16:26 (14569) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:18:10 (14604) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:20:53 (14616) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/25 03:20:53 (14616) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/25 03:20:53 (14616) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/25 03:22:48 (14622) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:25:38 (14672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:25:50 (14681) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:25:54 (14684) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/25 03:25:54 (14684) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/25 03:25:54 (14684) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/25 03:28:53 (14712) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:30:55 (14725) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/25 03:30:55 (14725) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/25 03:30:55 (14725) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/25 03:33:23 (14731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:35:31 (14763) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:35:56 (14792) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/25 03:35:56 (14792) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/25 03:35:56 (14792) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/25 03:36:00 (14793) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:38:38 (14830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:40:57 (14843) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/25 03:40:57 (14843) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/25 03:40:57 (14843) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/25 03:42:23 (14884) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:44:58 (14987) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:45:21 (15011) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:45:58 (15022) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/25 03:45:58 (15022) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/25 03:45:58 (15022) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/25 03:47:51 (15035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:50:59 (15077) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/25 03:50:59 (15077) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/25 03:50:59 (15077) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/25 03:51:33 (15081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:54:31 (15130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:54:47 (15132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 03:56:00 (15146) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/25 03:56:00 (15146) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/25 03:56:00 (15146) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/25 03:58:37 (15158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:00:59 (15240) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:01:01 (15246) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/25 04:01:01 (15246) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/25 04:01:01 (15246) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/25 04:03:39 (15290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:05:43 (15314) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:06:02 (15329) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/25 04:06:02 (15329) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/25 04:06:02 (15329) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/25 04:07:37 (15338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:10:28 (15369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:11:03 (15376) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/25 04:11:03 (15376) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/25 04:11:03 (15376) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/25 04:13:46 (15443) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:16:03 (15526) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:16:04 (15535) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/25 04:16:04 (15535) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/25 04:16:04 (15535) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/25 04:16:56 (15550) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:21:05 (15584) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/25 04:21:05 (15584) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/25 04:21:05 (15584) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/25 04:21:23 (15588) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:22:49 (15615) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:25:10 (15640) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:26:03 (15653) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:26:06 (15659) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/25 04:26:06 (15659) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/25 04:26:06 (15659) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/25 04:30:26 (15695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:31:08 (15702) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/25 04:31:08 (15702) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/25 04:31:08 (15702) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/25 04:32:33 (15724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:35:00 (15749) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:35:34 (15761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:36:09 (15771) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/25 04:36:09 (15771) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/25 04:36:09 (15771) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/25 04:39:53 (15799) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:41:10 (15811) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/25 04:41:10 (15811) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/25 04:41:10 (15811) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/25 04:43:30 (16132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:45:04 (16231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:45:16 (16249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:46:11 (16258) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/25 04:46:11 (16258) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/25 04:46:11 (16258) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/25 04:50:40 (16323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:51:12 (16330) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/25 04:51:12 (16330) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/25 04:51:12 (16330) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/25 04:53:11 (16353) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:55:03 (16383) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:55:15 (16389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 04:56:13 (16399) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/25 04:56:13 (16399) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/25 04:56:13 (16399) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/25 05:00:28 (16482) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:01:14 (16506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/25 05:01:14 (16506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/25 05:01:14 (16506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/25 05:03:15 (16531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:04:29 (16554) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:05:48 (16569) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:06:15 (16576) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/25 05:06:15 (16576) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/25 05:06:15 (16576) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/25 05:11:06 (16615) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:11:16 (16621) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/25 05:11:16 (16621) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/25 05:11:16 (16621) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/25 05:12:20 (16643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:13:35 (16666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:15:50 (16755) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:16:17 (16763) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/25 05:16:17 (16763) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/25 05:16:17 (16763) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/25 05:20:36 (16833) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:21:18 (16840) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/25 05:21:18 (16840) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/25 05:21:18 (16840) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/25 05:21:43 (16861) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:23:32 (16885) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:24:51 (16901) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:26:19 (16909) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/25 05:26:19 (16909) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/25 05:26:19 (16909) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/25 05:29:43 (16937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:31:20 (16969) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/25 05:31:20 (16969) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/25 05:31:20 (16969) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/25 05:31:22 (16970) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:33:24 (16994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:34:30 (17007) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:36:21 (17018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/25 05:36:21 (17018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/25 05:36:21 (17018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/25 05:40:18 (17051) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:41:22 (17078) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/25 05:41:22 (17078) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/25 05:41:22 (17078) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/25 05:41:24 (17079) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:42:54 (17102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:43:34 (17115) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:46:24 (17171) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/25 05:46:24 (17171) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/25 05:46:24 (17171) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/25 05:50:40 (17275) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:51:24 (17282) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/25 05:51:24 (17282) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/25 05:51:24 (17282) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/25 05:52:03 (17304) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:52:50 (17309) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:53:46 (17336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 05:56:25 (17351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/25 05:56:25 (17351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/25 05:56:25 (17351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/25 06:00:51 (17435) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:01:26 (17459) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/25 06:01:26 (17459) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/25 06:01:26 (17459) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/25 06:02:05 (17483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:03:47 (17509) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:03:56 (17515) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:06:27 (17533) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/25 06:06:27 (17533) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/25 06:06:27 (17533) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/25 06:11:28 (17565) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/25 06:11:28 (17565) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/25 06:11:28 (17565) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/25 06:11:38 (17573) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:12:24 (17600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:13:27 (17625) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:13:37 (17638) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:16:29 (17690) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/25 06:16:29 (17690) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/25 06:16:29 (17690) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/25 06:21:30 (17794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/25 06:21:30 (17794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/25 06:21:30 (17794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/25 06:21:49 (17798) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:22:21 (17825) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:23:38 (17851) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:23:38 (17852) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:26:31 (17875) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/25 06:26:31 (17875) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/25 06:26:31 (17875) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/25 06:31:32 (17904) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/25 06:31:32 (17904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/25 06:31:32 (17904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/25 06:31:56 (17908) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:33:09 (17939) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:33:14 (17945) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:33:45 (17970) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:36:33 (17984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/25 06:36:33 (17984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/25 06:36:33 (17984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/25 06:41:34 (18015) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/25 06:41:34 (18015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/25 06:41:34 (18015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/25 06:42:33 (18026) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:42:39 (18032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:43:22 (18063) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:44:07 (18088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:46:35 (18142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/25 06:46:35 (18142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/25 06:46:35 (18142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/25 06:51:36 (18240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/25 06:51:36 (18240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/25 06:51:36 (18240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/25 06:52:22 (18285) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:52:32 (18291) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:53:17 (18341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:53:31 (18350) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 06:56:37 (18358) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/25 06:56:37 (18358) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/25 06:56:37 (18358) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/25 06:58:42 (18384) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:01:31 (18546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:01:38 (18552) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/25 07:01:38 (18552) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/25 07:01:38 (18552) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/25 07:03:04 (18600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:03:12 (18603) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:03:25 (18615) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:06:39 (18627) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/25 07:06:39 (18627) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/25 07:06:39 (18627) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/25 07:10:48 (18660) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:11:40 (18670) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/25 07:11:40 (18670) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/25 07:11:40 (18670) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/25 07:12:58 (18717) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:13:01 (18726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:14:08 (18736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:16:41 (18789) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/25 07:16:41 (18789) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/25 07:16:41 (18789) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/25 07:18:19 (18797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:21:06 (18877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:21:42 (18886) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/25 07:21:42 (18886) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/25 07:21:42 (18886) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/25 07:22:22 (18908) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:23:56 (18969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:24:22 (18982) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:26:43 (18990) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/25 07:26:43 (18990) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/25 07:26:43 (18990) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/25 07:27:45 (18996) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:30:49 (19041) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:31:44 (19068) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/25 07:31:44 (19068) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/25 07:31:44 (19068) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/25 07:31:47 (19069) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:33:32 (19099) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:34:26 (19112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:36:45 (19120) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/25 07:36:45 (19120) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/25 07:36:45 (19120) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/25 07:39:52 (19143) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:41:26 (19179) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:41:46 (19183) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/25 07:41:46 (19183) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/25 07:41:46 (19183) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/25 07:44:24 (19217) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:45:03 (19231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:46:47 (19279) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/25 07:46:47 (19279) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/25 07:46:47 (19279) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/25 07:50:30 (19308) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:50:47 (19327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:51:30 (19356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:51:48 (19394) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/25 07:51:48 (19394) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/25 07:51:48 (19394) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/25 07:53:40 (19454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:55:39 (19470) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 07:56:49 (19477) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/25 07:56:49 (19477) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/25 07:56:49 (19477) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/25 07:59:58 (19500) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:01:50 (19600) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/25 08:01:50 (19600) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/25 08:01:50 (19600) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/25 08:02:10 (19609) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:03:50 (19635) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:06:33 (19652) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:06:51 (19658) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/25 08:06:51 (19658) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/25 08:06:51 (19658) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/25 08:09:48 (19681) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:11:52 (19697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/25 08:11:52 (19697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/25 08:11:52 (19697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/25 08:12:19 (19720) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:14:47 (19752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:16:53 (19805) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/25 08:16:53 (19805) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/25 08:16:53 (19805) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/25 08:17:20 (19810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:20:20 (19841) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:21:54 (19852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/25 08:21:54 (19852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/25 08:21:54 (19852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/25 08:22:23 (19874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:25:26 (19974) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:26:55 (19984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/25 08:26:55 (19984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/25 08:26:55 (19984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/25 08:28:00 (20004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:29:23 (20015) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:31:56 (20031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/25 08:31:56 (20031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/25 08:31:56 (20031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/25 08:33:20 (20057) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:34:49 (20082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:36:58 (20093) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/25 08:36:58 (20093) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/25 08:36:58 (20093) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/25 08:38:23 (20114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:39:22 (20124) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:41:59 (20144) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/25 08:41:59 (20144) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/25 08:41:59 (20144) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/25 08:42:45 (20168) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:45:14 (20198) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:47:00 (20248) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/25 08:47:00 (20248) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/25 08:47:00 (20248) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/25 08:47:41 (20268) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:49:09 (20278) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:52:01 (20295) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/25 08:52:01 (20295) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/25 08:52:01 (20295) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/25 08:53:06 (20323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:55:38 (20386) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:57:02 (20428) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/25 08:57:02 (20428) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/25 08:57:02 (20428) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/25 08:57:26 (20433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 08:59:10 (20458) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:02:03 (20543) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/25 09:02:03 (20543) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/25 09:02:03 (20543) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/25 09:02:52 (20568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:05:09 (20595) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:07:04 (20628) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/25 09:07:04 (20628) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/25 09:07:04 (20628) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/25 09:07:07 (20629) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:10:00 (20641) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:12:05 (20659) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/25 09:12:05 (20659) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/25 09:12:05 (20659) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/25 09:13:05 (20682) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:15:00 (20710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:16:39 (20766) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:17:06 (20775) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/25 09:17:06 (20775) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/25 09:17:06 (20775) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/25 09:20:30 (20805) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:22:07 (20817) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/25 09:22:07 (20817) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/25 09:22:07 (20817) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/25 09:23:29 (20843) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:25:39 (20903) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:26:21 (20918) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:27:08 (20956) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/25 09:27:08 (20956) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/25 09:27:08 (20956) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/25 09:29:43 (20980) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:32:09 (20993) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/25 09:32:09 (20993) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/25 09:32:09 (20993) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/25 09:34:21 (21022) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:35:51 (21045) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:36:49 (21073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:37:10 (21079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/25 09:37:10 (21079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/25 09:37:10 (21079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/25 09:39:11 (21088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:42:11 (21102) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/25 09:42:11 (21102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/25 09:42:11 (21102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/25 09:44:20 (21133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:45:01 (21158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:46:20 (21198) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:47:12 (21220) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/25 09:47:12 (21220) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/25 09:47:12 (21220) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/25 09:49:07 (21244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:52:13 (21258) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/25 09:52:13 (21258) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/25 09:52:13 (21258) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/25 09:54:16 (21287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:55:47 (21313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:55:51 (21322) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 09:57:14 (21369) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/25 09:57:14 (21369) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/25 09:57:14 (21369) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/25 09:58:30 (21425) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:02:15 (21506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/25 10:02:15 (21506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/25 10:02:15 (21506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/25 10:03:29 (21531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:05:47 (21557) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:06:07 (21569) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:07:17 (21592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/25 10:07:17 (21592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/25 10:07:17 (21592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/25 10:08:11 (21598) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:12:17 (21639) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/25 10:12:17 (21639) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/25 10:12:17 (21639) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/25 10:12:34 (21640) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:15:06 (21672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:16:31 (21710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:17:18 (21751) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/25 10:17:18 (21751) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/25 10:17:18 (21751) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/25 10:17:53 (21759) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:21:58 (21794) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:22:19 (21797) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/25 10:22:19 (21797) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/25 10:22:19 (21797) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/25 10:25:47 (21826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:26:15 (21838) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:27:20 (21900) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/25 10:27:20 (21900) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/25 10:27:20 (21900) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/25 10:27:34 (21904) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:32:21 (21954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/25 10:32:21 (21954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/25 10:32:21 (21954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/25 10:32:52 (21975) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:34:55 (22003) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:37:02 (22020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:37:22 (22027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/25 10:37:22 (22027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/25 10:37:22 (22027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/25 10:37:39 (22046) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:42:23 (22082) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/25 10:42:23 (22082) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/25 10:42:23 (22082) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/25 10:42:40 (22085) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:44:29 (22114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:46:37 (22158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:46:42 (22164) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:47:24 (22204) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/25 10:47:24 (22204) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/25 10:47:24 (22204) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/25 10:52:16 (22234) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:52:25 (22237) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/25 10:52:25 (22237) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/25 10:52:25 (22237) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/25 10:54:54 (22266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:56:20 (22285) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 10:57:26 (22307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/25 10:57:26 (22307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/25 10:57:26 (22307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/25 10:57:41 (22311) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:01:57 (22483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:02:27 (22486) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/25 11:02:27 (22486) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/25 11:02:27 (22486) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/25 11:04:29 (22512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:06:54 (22546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:07:20 (22556) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:07:28 (22562) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/25 11:07:28 (22562) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/25 11:07:28 (22562) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/25 11:11:01 (22591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:12:29 (22602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/25 11:12:29 (22602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/25 11:12:29 (22602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/25 11:14:41 (22630) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:16:16 (22664) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:17:19 (22718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:17:30 (22724) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/25 11:17:30 (22724) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/25 11:17:30 (22724) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/25 11:20:24 (22755) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:22:31 (22759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/25 11:22:31 (22759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/25 11:22:31 (22759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/25 11:25:37 (22804) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:26:13 (22822) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:26:18 (22828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:27:32 (22836) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/25 11:27:32 (22836) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/25 11:27:32 (22836) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/25 11:29:44 (22896) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:32:33 (22939) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/25 11:32:33 (22939) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/25 11:32:33 (22939) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/25 11:35:34 (22970) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:35:41 (22976) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:36:28 (23006) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:37:34 (23016) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/25 11:37:34 (23016) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/25 11:37:34 (23016) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/25 11:40:35 (23045) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:42:35 (23053) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/25 11:42:35 (23053) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/25 11:42:35 (23053) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/25 11:44:43 (23064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:45:29 (23109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:46:39 (23122) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:47:36 (23169) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/25 11:47:36 (23169) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/25 11:47:36 (23169) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/25 11:51:30 (23201) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:52:37 (23204) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/25 11:52:37 (23204) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/25 11:52:37 (23204) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/25 11:54:12 (23226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:56:18 (23260) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:56:52 (23275) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 11:57:38 (23282) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/25 11:57:38 (23282) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/25 11:57:38 (23282) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/25 12:02:17 (23416) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:02:39 (23419) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/25 12:02:39 (23419) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/25 12:02:39 (23419) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/25 12:04:38 (23478) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:06:54 (23514) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:06:56 (23523) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:07:40 (23530) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/25 12:07:40 (23530) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/25 12:07:40 (23530) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/25 12:11:37 (23561) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:12:41 (23564) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/25 12:12:41 (23564) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/25 12:12:41 (23564) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/25 12:14:59 (23593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:16:03 (23624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:17:29 (23678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:17:42 (23690) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/25 12:17:42 (23690) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/25 12:17:42 (23690) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/25 12:20:47 (23719) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:22:43 (23726) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/25 12:22:43 (23726) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/25 12:22:43 (23726) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/25 12:25:20 (23771) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:25:23 (23781) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:26:47 (23794) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:27:44 (23801) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/25 12:27:44 (23801) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/25 12:27:44 (23801) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/25 12:31:17 (23830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:32:25 (23876) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:32:45 (23892) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/25 12:32:45 (23892) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/25 12:32:45 (23892) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/25 12:34:42 (23950) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:36:12 (23982) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:36:17 (23991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:37:46 (23999) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/25 12:37:46 (23999) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/25 12:37:46 (23999) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/25 12:41:29 (24033) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:42:47 (24040) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/25 12:42:47 (24040) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/25 12:42:47 (24040) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/25 12:43:58 (24060) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:46:39 (24081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:46:57 (24107) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:47:48 (24160) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/25 12:47:48 (24160) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/25 12:47:48 (24160) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/25 12:48:12 (24162) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:52:04 (24210) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:52:49 (24213) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/25 12:52:49 (24213) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/25 12:52:49 (24213) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/25 12:54:03 (24233) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:56:05 (24249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:57:33 (24282) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 12:57:50 (24291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/25 12:57:50 (24291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/25 12:57:50 (24291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/25 13:02:51 (24391) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/25 13:02:51 (24391) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/25 13:02:51 (24391) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/25 13:02:56 (24392) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:04:05 (24436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:06:19 (24498) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:07:53 (24510) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/25 13:07:53 (24510) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/25 13:07:53 (24510) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/25 13:08:14 (24531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:12:54 (24553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/25 13:12:54 (24553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/25 13:12:54 (24553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/25 13:13:27 (24575) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:14:03 (24580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:17:09 (24643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:17:55 (24672) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/25 13:17:55 (24672) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/25 13:17:55 (24672) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/25 13:18:37 (24694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:22:37 (24732) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:22:56 (24734) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/25 13:22:56 (24734) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/25 13:22:56 (24734) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/25 13:23:23 (24741) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:27:57 (24800) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/25 13:27:57 (24800) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/25 13:27:57 (24800) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/25 13:28:03 (24801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:28:03 (24802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:28:54 (24821) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:32:00 (24864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:32:58 (24870) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/25 13:32:58 (24870) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/25 13:32:58 (24870) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/25 13:33:39 (24878) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:37:34 (24996) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:37:59 (25005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/25 13:37:59 (25005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/25 13:37:59 (25005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/25 13:38:17 (25009) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:41:35 (25044) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:43:00 (25051) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/25 13:43:00 (25051) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/25 13:43:00 (25051) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/25 13:43:27 (25056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:46:44 (25107) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:48:01 (25157) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/25 13:48:01 (25157) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/25 13:48:01 (25157) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/25 13:48:22 (25161) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:51:27 (25195) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:53:02 (25201) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/25 13:53:02 (25201) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/25 13:53:02 (25201) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/25 13:54:02 (25208) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:56:26 (25257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 13:58:03 (25268) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/25 13:58:03 (25268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/25 13:58:03 (25268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/25 13:59:07 (25274) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:01:10 (25372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:03:04 (25379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/25 14:03:04 (25379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/25 14:03:04 (25379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/25 14:03:39 (25384) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:06:52 (25473) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:08:05 (25515) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/25 14:08:05 (25515) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/25 14:08:05 (25515) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/25 14:08:19 (25519) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:10:58 (25553) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:12:43 (25563) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:13:06 (25569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/25 14:13:06 (25569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/25 14:13:06 (25569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/25 14:17:04 (25601) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:18:07 (25669) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/25 14:18:07 (25669) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/25 14:18:07 (25669) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/25 14:18:21 (25675) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:20:41 (25708) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:22:46 (25723) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:23:08 (25729) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/25 14:23:08 (25729) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/25 14:23:08 (25729) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/25 14:25:31 (25743) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:26:39 (25782) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:28:04 (25810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:28:09 (25816) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/25 14:28:09 (25816) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/25 14:28:09 (25816) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/25 14:31:03 (25847) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:31:46 (25853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:33:11 (25862) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/25 14:33:11 (25862) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/25 14:33:11 (25862) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/25 14:36:58 (25929) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:37:04 (25938) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:38:11 (25963) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/25 14:38:11 (25963) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/25 14:38:11 (25963) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/25 14:41:14 (26023) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:42:08 (26032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:43:12 (26042) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/25 14:43:12 (26042) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/25 14:43:12 (26042) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/25 14:46:34 (26073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:46:39 (26079) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:48:13 (26143) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/25 14:48:13 (26143) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/25 14:48:13 (26143) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/25 14:50:56 (26177) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:51:13 (26182) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:53:14 (26245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/25 14:53:14 (26245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/25 14:53:14 (26245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/25 14:56:03 (26255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:56:26 (26281) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 14:58:15 (26310) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/25 14:58:15 (26310) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/25 14:58:15 (26310) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/25 15:00:40 (26390) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:00:58 (26396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:03:16 (26491) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/25 15:03:16 (26491) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/25 15:03:16 (26491) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/25 15:05:45 (26501) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:06:45 (26529) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:08:17 (26590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/25 15:08:17 (26590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/25 15:08:17 (26590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/25 15:10:15 (26651) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:10:55 (26657) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:13:18 (26671) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/25 15:13:18 (26671) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/25 15:13:18 (26671) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/25 15:14:57 (26680) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:17:15 (26731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:18:19 (26775) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/25 15:18:19 (26775) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/25 15:18:19 (26775) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/25 15:20:08 (26808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:21:13 (26818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:23:20 (26829) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/25 15:23:20 (26829) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/25 15:23:20 (26829) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/25 15:24:32 (26839) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:27:40 (26886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:28:21 (26895) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/25 15:28:21 (26895) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/25 15:28:21 (26895) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/25 15:30:02 (26922) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:31:17 (26928) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:33:22 (26936) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/25 15:33:22 (26936) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/25 15:33:22 (26936) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/25 15:34:05 (26947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:37:30 (26995) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:38:23 (27005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/25 15:38:23 (27005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/25 15:38:23 (27005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/25 15:39:15 (27063) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:41:59 (27109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:43:24 (27116) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/25 15:43:24 (27116) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/25 15:43:24 (27116) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/25 15:44:57 (27126) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:46:32 (27172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:48:25 (27217) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/25 15:48:25 (27217) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/25 15:48:25 (27217) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/25 15:50:15 (27254) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:52:20 (27261) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:53:26 (27268) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/25 15:53:26 (27268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/25 15:53:26 (27268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/25 15:55:04 (27284) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:56:54 (27330) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 15:58:27 (27340) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/25 15:58:27 (27340) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/25 15:58:27 (27340) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/25 15:59:39 (27363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:01:21 (27440) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:03:29 (27451) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/25 16:03:29 (27451) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/25 16:03:29 (27451) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/25 16:05:02 (27460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:06:21 (27506) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:08:30 (27517) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/25 16:08:30 (27517) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/25 16:08:30 (27517) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/25 16:09:09 (27540) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:10:35 (27587) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:13:31 (27632) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/25 16:13:31 (27632) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/25 16:13:31 (27632) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/25 16:15:06 (27643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:17:00 (27693) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:18:10 (27747) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:18:32 (27763) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/25 16:18:32 (27763) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/25 16:18:32 (27763) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/25 16:20:39 (27780) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:23:33 (27790) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/25 16:23:33 (27790) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/25 16:23:33 (27790) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/25 16:25:50 (27803) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:26:26 (27830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:28:34 (27856) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/25 16:28:34 (27856) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/25 16:28:34 (27856) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/25 16:28:53 (27878) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:30:11 (27888) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:33:35 (27897) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/25 16:33:35 (27897) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/25 16:33:35 (27897) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/25 16:36:02 (27931) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:36:50 (27944) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:38:36 (27966) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/25 16:38:36 (27966) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/25 16:38:36 (27966) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/25 16:39:43 (27990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:40:05 (27999) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:43:37 (28095) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/25 16:43:37 (28095) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/25 16:43:37 (28095) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/25 16:45:05 (28119) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:46:00 (28133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:48:38 (28211) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/25 16:48:38 (28211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/25 16:48:38 (28211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/25 16:48:41 (28212) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:49:20 (28223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:53:39 (28242) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/25 16:53:39 (28242) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/25 16:53:39 (28242) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/25 16:54:51 (28270) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:55:28 (28282) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:58:00 (28331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 16:58:40 (28334) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/25 16:58:40 (28334) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/25 16:58:40 (28334) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/25 16:59:30 (28338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:03:41 (28424) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/25 17:03:41 (28424) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/25 17:03:41 (28424) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/25 17:04:29 (28447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:06:26 (28465) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:07:29 (28507) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:08:42 (28511) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/25 17:08:42 (28511) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/25 17:08:42 (28511) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/25 17:09:33 (28515) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:13:43 (28579) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/25 17:13:43 (28579) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/25 17:13:43 (28579) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/25 17:14:39 (28633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:17:06 (28676) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:17:25 (28698) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:18:44 (28736) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/25 17:18:44 (28736) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/25 17:18:44 (28736) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/25 17:19:42 (28747) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:23:45 (28766) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/25 17:23:46 (28766) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/25 17:23:46 (28766) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/25 17:24:10 (28787) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:27:23 (28822) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:28:01 (28849) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:28:46 (28852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/25 17:28:46 (28852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/25 17:28:46 (28852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/25 17:29:49 (28857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:33:47 (28876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/25 17:33:47 (28876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/25 17:33:47 (28876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/25 17:34:14 (28897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:37:31 (28936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:37:35 (28942) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:38:48 (28961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/25 17:38:48 (28961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/25 17:38:48 (28961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/25 17:39:50 (28966) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:43:49 (29043) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/25 17:43:49 (29043) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/25 17:43:49 (29043) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/25 17:43:53 (29044) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:47:06 (29117) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:48:03 (29123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:48:50 (29169) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/25 17:48:50 (29169) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/25 17:48:50 (29169) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/25 17:50:09 (29193) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:53:51 (29234) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/25 17:53:51 (29234) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/25 17:53:51 (29234) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/25 17:53:54 (29235) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:57:07 (29273) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:57:11 (29279) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 17:58:52 (29301) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/25 17:58:52 (29301) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/25 17:58:52 (29301) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/25 18:00:04 (29359) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:03:53 (29389) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/25 18:03:53 (29389) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/25 18:03:53 (29389) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/25 18:04:36 (29414) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:06:34 (29447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:07:13 (29453) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:08:54 (29479) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/25 18:08:54 (29479) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/25 18:08:54 (29479) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/25 18:10:07 (29488) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:13:55 (29501) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/25 18:13:55 (29501) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/25 18:13:55 (29501) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/25 18:14:15 (29523) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:17:18 (29649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:18:03 (29655) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:18:56 (29688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/25 18:18:56 (29688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/25 18:18:56 (29688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/25 18:19:44 (29693) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:20:32 (29731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:23:57 (29756) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/25 18:23:57 (29756) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/25 18:23:57 (29756) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/25 18:24:16 (29777) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:27:08 (29809) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:27:41 (29835) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:28:58 (29839) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/25 18:28:58 (29839) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/25 18:28:58 (29839) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/25 18:30:36 (29850) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:33:59 (29866) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/25 18:33:59 (29866) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/25 18:33:59 (29866) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/25 18:34:31 (29887) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:37:57 (29921) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:38:15 (29947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:39:00 (29950) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/25 18:39:00 (29950) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/25 18:39:00 (29950) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/25 18:39:55 (29959) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:40:05 (29969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:43:36 (30012) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:44:01 (30025) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/25 18:44:01 (30025) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/25 18:44:01 (30025) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/25 18:47:18 (30092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:48:40 (30151) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:49:02 (30170) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/25 18:49:02 (30170) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/25 18:49:02 (30170) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/25 18:49:27 (30174) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:54:03 (30233) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/25 18:54:03 (30233) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/25 18:54:03 (30233) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/25 18:54:10 (30234) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:56:53 (30269) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:58:35 (30299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:58:52 (30306) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 18:59:04 (30308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/25 18:59:05 (30308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/25 18:59:05 (30308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/25 19:03:31 (30411) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:04:05 (30421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/25 19:04:05 (30421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/25 19:04:05 (30421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/25 19:06:23 (30448) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:09:06 (30457) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/25 19:09:06 (30457) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/25 19:09:06 (30457) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/25 19:09:31 (30481) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:09:43 (30487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:14:07 (30532) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/25 19:14:07 (30532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/25 19:14:07 (30532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/25 19:14:22 (30533) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:15:28 (30563) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:18:44 (30636) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:19:08 (30695) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/25 19:19:08 (30695) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/25 19:19:08 (30695) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/25 19:20:12 (30705) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:24:09 (30744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/25 19:24:09 (30744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/25 19:24:09 (30744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/25 19:24:56 (30771) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:25:02 (30780) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:28:37 (30826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:29:10 (30829) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/25 19:29:10 (30829) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/25 19:29:10 (30829) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/25 19:30:04 (30838) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:32:40 (30856) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:34:11 (30876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/25 19:34:11 (30876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/25 19:34:11 (30876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/25 19:34:33 (30880) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:35:42 (30907) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:39:05 (30957) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:39:12 (30959) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/25 19:39:12 (30959) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/25 19:39:12 (30959) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/25 19:40:13 (30968) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:43:41 (30991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:44:13 (30998) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/25 19:44:13 (30998) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/25 19:44:13 (30998) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/25 19:46:35 (31036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:48:59 (31106) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:49:14 (31129) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/25 19:49:14 (31129) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/25 19:49:14 (31129) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/25 19:49:16 (31130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:54:15 (31191) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/25 19:54:15 (31191) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/25 19:54:15 (31191) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/25 19:54:23 (31195) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:56:06 (31238) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:58:13 (31272) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 19:59:16 (31277) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/25 19:59:16 (31277) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/25 19:59:16 (31277) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/25 19:59:50 (31282) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:04:17 (31369) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/25 20:04:17 (31369) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/25 20:04:17 (31369) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/25 20:05:18 (31391) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:05:45 (31417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:07:18 (31448) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:09:08 (31462) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:09:18 (31468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/25 20:09:18 (31468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/25 20:09:18 (31468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/25 20:14:19 (31484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/25 20:14:19 (31484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/25 20:14:19 (31484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/25 20:15:39 (31506) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:16:15 (31533) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:17:16 (31565) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:19:20 (31636) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/25 20:19:20 (31636) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/25 20:19:20 (31636) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/25 20:19:33 (31640) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:24:21 (31729) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/25 20:24:21 (31729) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/25 20:24:21 (31729) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/25 20:24:46 (31733) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:25:44 (31760) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:28:07 (31792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:28:44 (31799) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:29:23 (31806) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/25 20:29:23 (31806) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/25 20:29:23 (31806) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/25 20:33:30 (31840) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:34:23 (31857) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/25 20:34:23 (31857) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/25 20:34:23 (31857) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/25 20:34:53 (31862) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:35:58 (31889) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:38:40 (31923) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:39:24 (31928) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/25 20:39:24 (31928) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/25 20:39:24 (31928) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/25 20:39:35 (31932) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:44:25 (31973) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/25 20:44:25 (31973) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/25 20:44:25 (31973) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/25 20:44:30 (31974) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:45:25 (32001) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:47:53 (32033) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:49:26 (32062) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/25 20:49:26 (32062) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/25 20:49:26 (32062) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/25 20:50:27 (32099) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:54:11 (32158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:54:27 (32199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/25 20:54:27 (32199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/25 20:54:27 (32199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/25 20:54:38 (32200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:56:56 (32232) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 20:59:28 (32242) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/25 20:59:28 (32242) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/25 20:59:28 (32242) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/25 21:01:15 (32327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:03:31 (32345) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:04:29 (32352) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/25 21:04:29 (32352) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/25 21:04:29 (32352) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/25 21:05:34 (32391) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:07:18 (32422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:09:30 (32432) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/25 21:09:30 (32432) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/25 21:09:30 (32432) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/25 21:11:58 (32447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:13:11 (32465) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:14:31 (32472) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/25 21:14:31 (32472) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/25 21:14:31 (32472) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/25 21:16:30 (32531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:16:48 (32543) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:19:32 (32554) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/25 21:19:32 (32554) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/25 21:19:32 (32554) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/25 21:22:37 (32655) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:22:44 (32661) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:24:33 (32701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/25 21:24:33 (32701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/25 21:24:33 (32701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/25 21:25:36 (32738) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:27:41 (303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:29:34 (312) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/25 21:29:34 (312) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/25 21:29:34 (312) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/25 21:32:31 (324) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:33:42 (340) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:34:35 (371) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/25 21:34:35 (371) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/25 21:34:35 (371) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/25 21:35:17 (393) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:37:36 (430) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:39:36 (437) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/25 21:39:36 (437) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/25 21:39:36 (437) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/25 21:43:19 (457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:43:27 (463) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:44:37 (508) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/25 21:44:37 (508) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/25 21:44:37 (508) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/25 21:44:39 (509) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:48:08 (548) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:49:38 (551) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/25 21:49:38 (551) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/25 21:49:38 (551) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/25 21:53:34 (643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:53:42 (652) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:54:39 (696) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/25 21:54:39 (696) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/25 21:54:39 (696) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/25 21:54:48 (729) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:58:45 (767) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 21:59:41 (770) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/25 21:59:41 (770) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/25 21:59:41 (770) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/25 22:02:46 (852) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:04:15 (883) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:04:41 (889) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/25 22:04:41 (889) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/25 22:04:41 (889) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/25 22:05:49 (913) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:09:37 (951) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:09:42 (953) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/25 22:09:42 (953) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/25 22:09:42 (953) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/25 22:12:23 (965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:13:26 (975) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:14:43 (998) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/25 22:14:43 (998) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/25 22:14:43 (998) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/25 22:16:11 (1022) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:18:52 (1058) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:19:44 (1061) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/25 22:19:44 (1061) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/25 22:19:44 (1061) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/25 22:21:46 (1095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:22:55 (1131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:24:45 (1198) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/25 22:24:45 (1198) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/25 22:24:45 (1198) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/25 22:25:33 (1222) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:29:38 (1297) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:29:46 (1299) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/25 22:29:46 (1299) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/25 22:29:46 (1299) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/25 22:31:04 (1309) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:33:35 (1321) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:34:47 (1343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/25 22:34:47 (1343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/25 22:34:47 (1343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/25 22:36:19 (1373) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:39:10 (1405) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:39:48 (1407) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/25 22:39:48 (1407) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/25 22:39:48 (1407) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/25 22:41:54 (1418) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:43:42 (1436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:44:49 (1463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/25 22:44:49 (1463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/25 22:44:49 (1463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/25 22:45:44 (1512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:48:46 (1553) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:49:50 (1556) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/25 22:49:50 (1556) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/25 22:49:50 (1556) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/25 22:52:35 (1658) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:52:56 (1673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:54:51 (1686) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/25 22:54:51 (1686) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/25 22:54:51 (1686) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/25 22:55:52 (1764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:58:34 (1843) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 22:59:52 (1846) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/25 22:59:52 (1846) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/25 22:59:52 (1846) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/25 23:02:54 (1992) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:03:03 (2003) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:04:53 (2040) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/25 23:04:53 (2040) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/25 23:04:53 (2040) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/25 23:05:41 (2065) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:07:40 (2102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:09:54 (2112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/25 23:09:54 (2112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/25 23:09:54 (2112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/25 23:13:01 (2133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:13:34 (2147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:14:55 (2175) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/25 23:14:55 (2175) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/25 23:14:55 (2175) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/25 23:15:55 (2200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:17:37 (2244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:19:56 (2257) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/25 23:19:56 (2257) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/25 23:19:56 (2257) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/25 23:23:28 (2315) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:24:15 (2334) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:24:57 (2355) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/25 23:24:57 (2355) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/25 23:24:57 (2355) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/25 23:25:54 (2377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:27:29 (2449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:29:59 (2489) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/25 23:29:59 (2489) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/25 23:29:59 (2489) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/25 23:33:20 (2503) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:33:33 (2512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:35:00 (2538) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/25 23:35:00 (2538) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/25 23:35:00 (2538) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/25 23:36:09 (2563) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:38:05 (2597) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:40:01 (2601) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/25 23:40:01 (2601) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/25 23:40:01 (2601) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/25 23:43:04 (2612) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:43:33 (2621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:45:02 (2649) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/25 23:45:02 (2649) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/25 23:45:02 (2649) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/25 23:46:20 (2681) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:47:41 (2712) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:50:03 (2721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/25 23:50:03 (2721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/25 23:50:03 (2721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/25 23:52:58 (2769) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:53:53 (2797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:55:04 (2823) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/25 23:55:04 (2823) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/25 23:55:04 (2823) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/25 23:56:10 (2848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/25 23:57:54 (2914) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:00:05 (3006) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/26 00:00:05 (3006) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/26 00:00:05 (3006) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/26 00:02:51 (3037) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:03:16 (3047) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:05:06 (3074) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/26 00:05:06 (3074) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/26 00:05:06 (3074) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/26 00:06:59 (3102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:07:23 (3132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:10:07 (3141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/26 00:10:07 (3141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/26 00:10:07 (3141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/26 00:12:33 (3150) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:13:19 (3163) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:15:08 (3191) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/26 00:15:08 (3191) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/26 00:15:08 (3191) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/26 00:16:32 (3219) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:17:03 (3252) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:20:09 (3264) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/26 00:20:09 (3264) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/26 00:20:09 (3264) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/26 00:23:13 (3317) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:24:14 (3331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:25:10 (3353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/26 00:25:10 (3353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/26 00:25:10 (3353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/26 00:26:14 (3382) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:26:18 (3398) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:27:28 (3428) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:30:11 (3476) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/26 00:30:11 (3476) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/26 00:30:11 (3476) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/26 00:33:45 (3521) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:34:44 (3546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:35:12 (3553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/26 00:35:12 (3553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/26 00:35:12 (3553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/26 00:35:31 (3574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:38:22 (3606) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:40:13 (3614) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/26 00:40:13 (3614) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/26 00:40:13 (3614) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/26 00:43:58 (3637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:44:12 (3647) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:44:59 (3673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:45:14 (3683) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/26 00:45:14 (3683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/26 00:45:14 (3683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/26 00:48:39 (3707) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:50:15 (3715) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/26 00:50:15 (3715) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/26 00:50:15 (3715) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/26 00:54:00 (3790) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:54:02 (3806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:54:49 (3816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:55:16 (3843) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/26 00:55:16 (3843) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/26 00:55:16 (3843) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/26 00:55:33 (3844) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:57:44 (3859) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 00:58:35 (3896) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:00:17 (3994) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/26 01:00:17 (3994) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/26 01:00:17 (3994) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/26 01:03:23 (4073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:05:24 (4141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/26 01:05:24 (4141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/26 01:05:24 (4141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/26 01:05:34 (4254) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:05:45 (4263) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:05:50 (4272) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:06:26 (4300) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:10:25 (4311) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/26 01:10:25 (4311) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/26 01:10:25 (4311) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/26 01:12:46 (4318) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:14:14 (4340) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:15:26 (4360) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/26 01:15:26 (4360) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/26 01:15:26 (4360) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/26 01:15:30 (4361) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:15:56 (4390) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:16:04 (4412) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:17:15 (4447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:20:27 (4457) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/26 01:20:27 (4457) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/26 01:20:27 (4457) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/26 01:25:28 (4531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/26 01:25:28 (4531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/26 01:25:28 (4531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/26 01:26:06 (4553) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:26:29 (4568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:26:34 (4594) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:26:56 (4600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:30:29 (4618) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/26 01:30:29 (4618) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/26 01:30:29 (4618) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/26 01:32:56 (4695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:35:30 (4737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/26 01:35:30 (4737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/26 01:35:30 (4737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/26 01:36:09 (4782) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:36:17 (4784) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:37:02 (4797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:37:12 (4807) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:37:48 (4820) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:40:31 (4844) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/26 01:40:31 (4844) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/26 01:40:31 (4844) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/26 01:45:32 (4891) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/26 01:45:32 (4891) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/26 01:45:32 (4891) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/26 01:45:51 (4895) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:45:57 (4897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:46:35 (4924) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:46:55 (4936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:50:33 (4954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/26 01:50:33 (4954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/26 01:50:33 (4954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/26 01:55:12 (5028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:55:34 (5048) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/26 01:55:34 (5048) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/26 01:55:34 (5048) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/26 01:56:39 (5073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:56:46 (5082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 01:57:17 (5092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:00:35 (5164) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/26 02:00:35 (5164) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/26 02:00:35 (5164) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/26 02:04:26 (5281) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:05:37 (5291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/26 02:05:37 (5291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/26 02:05:37 (5291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/26 02:06:22 (5334) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:06:33 (5343) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:07:18 (5353) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:10:38 (5379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/26 02:10:38 (5379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/26 02:10:38 (5379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/26 02:14:05 (5403) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:15:28 (5433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:15:30 (5442) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:15:39 (5448) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/26 02:15:39 (5448) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/26 02:15:39 (5448) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/26 02:16:34 (5471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:20:40 (5491) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/26 02:20:40 (5491) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/26 02:20:40 (5491) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/26 02:23:56 (5560) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:24:33 (5566) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:25:41 (5611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/26 02:25:41 (5611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/26 02:25:41 (5611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/26 02:25:51 (5612) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:26:02 (5627) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:30:42 (5707) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/26 02:30:42 (5707) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/26 02:30:42 (5707) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/26 02:33:54 (5770) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:34:01 (5772) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:35:30 (5842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:35:43 (5863) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/26 02:35:43 (5863) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/26 02:35:43 (5863) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/26 02:35:48 (5864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:40:44 (5893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/26 02:40:44 (5893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/26 02:40:44 (5893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/26 02:44:01 (5900) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:44:41 (5933) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:44:51 (5939) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:45:45 (5960) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/26 02:45:45 (5960) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/26 02:45:45 (5960) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/26 02:46:38 (5982) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:50:46 (6000) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/26 02:50:46 (6000) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/26 02:50:46 (6000) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/26 02:54:12 (6059) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:54:46 (6103) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:54:53 (6109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 02:55:47 (6112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/26 02:55:47 (6112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/26 02:55:47 (6112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/26 02:56:34 (6137) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:00:48 (6293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/26 03:00:48 (6293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/26 03:00:48 (6293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/26 03:03:42 (6378) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:03:48 (6404) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:04:06 (6425) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:05:49 (6471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/26 03:05:49 (6471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/26 03:05:49 (6471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/26 03:06:37 (6528) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:10:50 (6570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/26 03:10:50 (6570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/26 03:10:50 (6570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/26 03:13:33 (6619) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:13:38 (6621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:13:48 (6633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:15:36 (6675) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:15:51 (6684) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/26 03:15:51 (6684) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/26 03:15:51 (6684) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/26 03:20:52 (6701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/26 03:20:52 (6701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/26 03:20:52 (6701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/26 03:22:39 (6749) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:23:34 (6762) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:24:20 (6806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:25:23 (6833) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:25:54 (6842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/26 03:25:54 (6842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/26 03:25:54 (6842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/26 03:30:54 (6859) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/26 03:30:54 (6859) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/26 03:30:54 (6859) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/26 03:33:14 (6883) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:33:35 (6895) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:34:22 (6922) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:35:55 (6968) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/26 03:35:55 (6968) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/26 03:35:55 (6968) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/26 03:36:15 (6990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:40:56 (7042) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/26 03:40:56 (7042) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/26 03:40:56 (7042) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/26 03:42:40 (7070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:43:35 (7097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:44:12 (7103) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:45:52 (7130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:45:57 (7139) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/26 03:45:57 (7139) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/26 03:45:57 (7139) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/26 03:50:58 (7156) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/26 03:50:58 (7156) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/26 03:50:58 (7156) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/26 03:53:30 (7205) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:53:53 (7231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:54:38 (7258) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:55:22 (7287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 03:55:59 (7296) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/26 03:55:59 (7296) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/26 03:55:59 (7296) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/26 04:01:00 (7360) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/26 04:01:00 (7360) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/26 04:01:00 (7360) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/26 04:03:37 (7414) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:03:53 (7443) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:03:58 (7449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:05:19 (7475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:06:01 (7484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/26 04:06:01 (7484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/26 04:06:01 (7484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/26 04:11:02 (7568) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/26 04:11:02 (7568) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/26 04:11:02 (7568) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/26 04:13:24 (8019) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:13:31 (8060) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:14:17 (8090) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:14:48 (8116) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:16:03 (8126) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/26 04:16:03 (8126) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/26 04:16:03 (8126) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/26 04:21:04 (8143) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/26 04:21:04 (8143) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/26 04:21:04 (8143) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/26 04:22:40 (8173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:24:06 (8244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:24:21 (8254) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:24:29 (8273) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:26:05 (8284) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/26 04:26:05 (8284) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/26 04:26:05 (8284) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/26 04:31:06 (8298) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/26 04:31:06 (8298) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/26 04:31:06 (8298) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/26 04:33:38 (8348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:33:53 (8374) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:34:09 (8376) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:34:28 (8389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:36:07 (8398) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/26 04:36:07 (8398) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/26 04:36:07 (8398) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/26 04:41:08 (8482) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/26 04:41:08 (8482) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/26 04:41:08 (8482) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/26 04:43:32 (8527) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:43:56 (8532) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:44:35 (8542) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:44:53 (8568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:46:09 (8578) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/26 04:46:09 (8578) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/26 04:46:09 (8578) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/26 04:51:10 (8592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/26 04:51:10 (8592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/26 04:51:10 (8592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/26 04:53:12 (8642) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:53:41 (8666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:54:41 (8712) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:55:00 (8728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 04:56:11 (8735) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/26 04:56:11 (8735) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/26 04:56:11 (8735) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/26 05:01:12 (8819) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/26 05:01:12 (8819) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/26 05:01:12 (8819) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/26 05:03:06 (8849) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:03:34 (8875) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:03:46 (8896) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:05:50 (8910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:06:13 (8918) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/26 05:06:13 (8918) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/26 05:06:13 (8918) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/26 05:11:14 (9005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/26 05:11:14 (9005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/26 05:11:14 (9005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/26 05:13:04 (9026) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:13:27 (9076) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:13:32 (9078) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:15:16 (9095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:16:15 (9102) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/26 05:16:15 (9102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/26 05:16:15 (9102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/26 05:21:16 (9121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/26 05:21:16 (9121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/26 05:21:16 (9121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/26 05:22:41 (9169) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:22:53 (9196) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:24:06 (9226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:24:51 (9249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:26:17 (9260) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/26 05:26:17 (9260) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/26 05:26:17 (9260) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/26 05:31:18 (9282) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/26 05:31:18 (9282) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/26 05:31:18 (9282) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/26 05:33:01 (9307) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:33:13 (9334) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:33:52 (9364) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:33:58 (9370) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:36:19 (9377) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/26 05:36:19 (9377) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/26 05:36:19 (9377) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/26 05:41:20 (9432) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/26 05:41:20 (9432) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/26 05:41:20 (9432) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/26 05:42:51 (9504) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:43:02 (9516) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:43:52 (9543) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:44:09 (9548) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:46:21 (9557) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/26 05:46:21 (9557) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/26 05:46:21 (9557) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/26 05:51:22 (9574) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/26 05:51:22 (9574) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/26 05:51:22 (9574) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/26 05:52:48 (9623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:53:34 (9636) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:54:15 (9660) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:54:39 (9690) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 05:56:23 (9714) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/26 05:56:23 (9714) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/26 05:56:23 (9714) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/26 06:01:24 (9798) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/26 06:01:24 (9798) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/26 06:01:24 (9798) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/26 06:03:28 (9826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:03:48 (9858) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:03:57 (9864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:04:31 (9870) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:06:25 (9895) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/26 06:06:25 (9895) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/26 06:06:25 (9895) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/26 06:11:26 (9951) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/26 06:11:26 (9951) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/26 06:11:26 (9951) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/26 06:13:01 (9979) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:13:43 (10034) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:14:02 (10046) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:14:45 (10056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:16:27 (10079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/26 06:16:28 (10079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/26 06:16:28 (10079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/26 06:21:28 (10099) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/26 06:21:28 (10099) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/26 06:21:28 (10099) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/26 06:22:42 (10148) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:23:13 (10153) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:23:40 (10180) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:24:01 (10207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:26:29 (10237) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/26 06:26:29 (10237) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/26 06:26:29 (10237) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/26 06:31:30 (10257) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/26 06:31:30 (10257) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/26 06:31:30 (10257) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/26 06:32:26 (10279) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:33:02 (10286) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:34:05 (10296) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:34:23 (10338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:36:31 (10351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/26 06:36:31 (10351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/26 06:36:31 (10351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/26 06:41:32 (10371) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/26 06:41:32 (10371) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/26 06:41:32 (10371) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/26 06:42:16 (10392) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:43:13 (10438) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:44:11 (10470) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:44:21 (10476) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:46:33 (10535) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/26 06:46:33 (10535) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/26 06:46:33 (10535) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/26 06:50:36 (10557) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:51:34 (10577) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/26 06:51:34 (10577) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/26 06:51:34 (10577) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/26 06:52:37 (10672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:52:43 (10674) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:54:56 (10688) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:55:15 (10728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 06:56:35 (10758) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/26 06:56:35 (10758) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/26 06:56:35 (10758) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/26 07:01:36 (10848) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/26 07:01:36 (10848) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/26 07:01:36 (10848) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/26 07:02:26 (10872) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:02:51 (10877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:04:53 (10958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:05:43 (10998) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:05:47 (11004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:06:37 (11029) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/26 07:06:37 (11029) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/26 07:06:37 (11029) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/26 07:11:38 (11049) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/26 07:11:38 (11049) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/26 07:11:38 (11049) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/26 07:12:12 (11053) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:12:51 (11080) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:15:23 (11147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:16:31 (11192) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:16:39 (11201) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/26 07:16:39 (11201) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/26 07:16:39 (11201) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/26 07:21:25 (11238) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:21:40 (11248) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/26 07:21:40 (11248) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/26 07:21:40 (11248) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/26 07:21:56 (11249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:23:39 (11312) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:25:42 (11358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:26:41 (11383) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/26 07:26:41 (11383) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/26 07:26:41 (11383) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/26 07:27:14 (11388) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:27:25 (11408) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:31:42 (11435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/26 07:31:42 (11435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/26 07:31:42 (11435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/26 07:31:44 (11436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:33:37 (11468) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:35:41 (11507) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:36:30 (11522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:36:43 (11528) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/26 07:36:43 (11528) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/26 07:36:43 (11528) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/26 07:40:53 (11549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:41:44 (11557) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/26 07:41:44 (11557) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/26 07:41:44 (11557) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/26 07:44:20 (11581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:45:13 (11655) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:46:20 (11670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:46:46 (11697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/26 07:46:46 (11697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/26 07:46:46 (11697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/26 07:50:40 (11733) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:51:46 (11740) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/26 07:51:46 (11740) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/26 07:51:46 (11740) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/26 07:55:12 (11806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:56:00 (11851) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:56:25 (11863) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 07:56:47 (11870) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/26 07:56:47 (11870) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/26 07:56:47 (11870) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/26 08:01:34 (11964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:01:48 (11970) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/26 08:01:48 (11970) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/26 08:01:48 (11970) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/26 08:05:09 (12009) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:06:10 (12017) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:06:49 (12044) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:06:50 (12053) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/26 08:06:50 (12053) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/26 08:06:50 (12053) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/26 08:11:51 (12073) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/26 08:11:51 (12073) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/26 08:11:51 (12073) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/26 08:12:30 (12078) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:14:54 (12121) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:16:52 (12170) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/26 08:16:52 (12170) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/26 08:16:52 (12170) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/26 08:16:53 (12171) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:17:27 (12200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:21:30 (12259) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:21:53 (12268) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/26 08:21:53 (12268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/26 08:21:53 (12268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/26 08:23:57 (12315) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:26:49 (12359) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:26:54 (12365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/26 08:26:54 (12365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/26 08:26:54 (12365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/26 08:27:36 (12387) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:31:22 (12417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:31:55 (12424) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/26 08:31:55 (12424) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/26 08:31:55 (12424) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/26 08:33:15 (12449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:36:10 (12472) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:36:56 (12479) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/26 08:36:56 (12479) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/26 08:36:56 (12479) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/26 08:37:50 (12501) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:41:37 (12530) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:41:57 (12537) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/26 08:41:57 (12537) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/26 08:41:57 (12537) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/26 08:43:14 (12562) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:46:58 (12583) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/26 08:46:58 (12583) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/26 08:46:58 (12583) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/26 08:47:08 (12623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:48:41 (12653) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:51:41 (12711) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:51:59 (12717) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/26 08:51:59 (12717) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/26 08:51:59 (12717) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/26 08:54:05 (12784) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:57:00 (12810) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/26 08:57:00 (12810) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/26 08:57:00 (12810) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/26 08:58:00 (12815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 08:59:09 (12849) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:02:01 (12934) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/26 09:02:01 (12934) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/26 09:02:01 (12934) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/26 09:02:34 (12939) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:03:41 (12969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:07:02 (12991) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/26 09:07:02 (12991) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/26 09:07:02 (12991) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/26 09:08:52 (13020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:08:55 (13029) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:12:03 (13046) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/26 09:12:03 (13046) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/26 09:12:03 (13046) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/26 09:12:49 (13068) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:13:07 (13076) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:17:04 (13104) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/26 09:17:04 (13104) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/26 09:17:04 (13104) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/26 09:18:24 (13165) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:19:21 (13180) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:22:05 (13229) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/26 09:22:05 (13229) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/26 09:22:05 (13229) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/26 09:22:51 (13258) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:23:50 (13288) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:27:06 (13333) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/26 09:27:06 (13333) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/26 09:27:06 (13333) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/26 09:28:40 (13363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:29:19 (13375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:32:07 (13395) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/26 09:32:07 (13395) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/26 09:32:07 (13395) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/26 09:32:50 (13417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:34:43 (13439) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:37:08 (13447) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/26 09:37:08 (13447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/26 09:37:08 (13447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/26 09:39:12 (13478) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:39:14 (13484) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:42:09 (13507) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/26 09:42:09 (13507) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/26 09:42:09 (13507) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/26 09:42:43 (13529) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:44:25 (13550) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:47:10 (13559) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/26 09:47:10 (13559) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/26 09:47:10 (13559) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/26 09:48:21 (13584) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:49:14 (13600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:52:11 (13689) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/26 09:52:11 (13689) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/26 09:52:11 (13689) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/26 09:52:55 (13711) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:54:55 (13758) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:57:12 (13787) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/26 09:57:12 (13787) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/26 09:57:12 (13787) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/26 09:58:16 (13809) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 09:58:59 (13825) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:02:13 (13935) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/26 10:02:13 (13935) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/26 10:02:13 (13935) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/26 10:02:23 (13936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:05:31 (13959) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:07:14 (13967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/26 10:07:14 (13967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/26 10:07:14 (13967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/26 10:07:54 (13989) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:08:54 (14005) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:12:15 (14024) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/26 10:12:15 (14024) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/26 10:12:15 (14024) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/26 10:13:09 (14049) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:15:24 (14071) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:17:16 (14082) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/26 10:17:16 (14082) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/26 10:17:16 (14082) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/26 10:18:04 (14107) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:18:18 (14113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:22:17 (14196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/26 10:22:17 (14196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/26 10:22:17 (14196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/26 10:22:25 (14197) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:26:03 (14277) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:27:18 (14322) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/26 10:27:18 (14322) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/26 10:27:18 (14322) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/26 10:27:22 (14323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:28:25 (14336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:32:19 (14364) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/26 10:32:19 (14364) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/26 10:32:19 (14364) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/26 10:33:25 (14386) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:35:45 (14409) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:36:59 (14436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:37:20 (14445) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/26 10:37:20 (14445) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/26 10:37:20 (14445) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/26 10:38:19 (14450) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:42:21 (14473) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/26 10:42:21 (14473) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/26 10:42:21 (14473) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/26 10:43:42 (14499) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:46:33 (14541) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:46:41 (14551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:47:22 (14557) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/26 10:47:22 (14557) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/26 10:47:22 (14557) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/26 10:47:47 (14565) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:52:24 (14619) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/26 10:52:24 (14619) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/26 10:52:24 (14619) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/26 10:54:14 (14705) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:56:10 (14751) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:57:15 (14788) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 10:57:24 (14794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/26 10:57:24 (14794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/26 10:57:24 (14794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/26 10:58:37 (14803) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:02:25 (14889) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/26 11:02:25 (14889) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/26 11:02:25 (14889) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/26 11:03:20 (14911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:06:52 (14952) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:07:20 (14964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:07:26 (14970) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/26 11:07:26 (14970) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/26 11:07:26 (14970) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/26 11:07:35 (14974) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:12:27 (15001) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/26 11:12:27 (15001) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/26 11:12:27 (15001) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/26 11:14:08 (15024) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:17:13 (15050) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:17:28 (15076) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/26 11:17:28 (15076) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/26 11:17:28 (15076) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/26 11:17:37 (15078) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:18:11 (15090) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:22:29 (15114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/26 11:22:29 (15114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/26 11:22:29 (15114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/26 11:23:23 (15172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:27:30 (15258) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/26 11:27:30 (15258) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/26 11:27:30 (15258) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/26 11:28:06 (15284) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:28:23 (15290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:28:52 (15303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:32:31 (15346) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/26 11:32:31 (15346) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/26 11:32:31 (15346) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/26 11:32:48 (15348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:37:16 (15372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:37:32 (15378) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/26 11:37:32 (15378) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/26 11:37:32 (15378) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/26 11:38:10 (15400) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:38:53 (15417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:42:33 (15456) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/26 11:42:33 (15456) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/26 11:42:33 (15456) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/26 11:42:43 (15458) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:47:32 (15504) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:47:34 (15510) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/26 11:47:34 (15510) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/26 11:47:34 (15510) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/26 11:47:41 (15512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:49:33 (15530) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:52:20 (15566) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:52:35 (15570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/26 11:52:35 (15570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/26 11:52:35 (15570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/26 11:56:43 (15709) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:57:36 (15722) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/26 11:57:36 (15722) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/26 11:57:36 (15722) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/26 11:58:36 (15745) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 11:59:27 (15758) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:02:07 (15864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:02:37 (15866) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/26 12:02:37 (15866) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/26 12:02:37 (15866) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/26 12:06:36 (15892) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:07:38 (15899) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/26 12:07:38 (15899) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/26 12:07:38 (15899) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/26 12:08:41 (15923) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:09:47 (15936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:11:46 (15968) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:12:39 (15977) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/26 12:12:39 (15977) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/26 12:12:39 (15977) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/26 12:16:40 (16008) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:17:40 (16015) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/26 12:17:40 (16015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/26 12:17:40 (16015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/26 12:18:50 (16041) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:18:58 (16047) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:21:53 (16083) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:22:41 (16096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/26 12:22:41 (16096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/26 12:22:41 (16096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/26 12:26:14 (16164) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:27:43 (16233) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/26 12:27:43 (16233) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/26 12:27:43 (16233) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/26 12:29:12 (16258) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:29:19 (16264) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:31:11 (16299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:32:44 (16303) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/26 12:32:44 (16303) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/26 12:32:44 (16303) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/26 12:36:23 (16319) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:37:45 (16342) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/26 12:37:45 (16342) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/26 12:37:45 (16342) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/26 12:38:50 (16365) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:39:42 (16382) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:39:45 (16398) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:41:18 (16431) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:42:46 (16438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/26 12:42:46 (16438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/26 12:42:46 (16438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/26 12:46:33 (16457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:47:47 (16482) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/26 12:47:47 (16482) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/26 12:47:47 (16482) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/26 12:49:35 (16505) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:50:37 (16522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:51:26 (16549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:52:48 (16556) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/26 12:52:48 (16556) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/26 12:52:48 (16556) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/26 12:56:46 (16636) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 12:57:49 (16663) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/26 12:57:49 (16663) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/26 12:57:49 (16663) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/26 12:59:36 (16715) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:00:09 (16808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:00:10 (16814) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:00:48 (16844) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:02:50 (16868) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/26 13:02:50 (16868) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/26 13:02:50 (16868) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/26 13:06:13 (16878) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:07:51 (16889) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/26 13:07:51 (16889) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/26 13:07:51 (16889) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/26 13:09:26 (16910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:10:58 (16942) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:11:22 (16971) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:12:52 (16981) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/26 13:12:52 (16981) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/26 13:12:52 (16981) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/26 13:16:57 (16997) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:17:53 (17004) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/26 13:17:53 (17004) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/26 13:17:53 (17004) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/26 13:19:34 (17010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:20:22 (17056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:22:16 (17093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:22:54 (17096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/26 13:22:54 (17096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/26 13:22:54 (17096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/26 13:26:37 (17131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:27:55 (17200) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/26 13:27:55 (17200) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/26 13:27:55 (17200) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/26 13:29:25 (17207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:30:09 (17290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:30:27 (17299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:32:28 (17343) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:32:56 (17346) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/26 13:32:56 (17346) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/26 13:32:56 (17346) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/26 13:35:52 (17354) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:37:57 (17365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/26 13:37:57 (17365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/26 13:37:57 (17365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/26 13:39:23 (17387) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:40:05 (17419) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:42:58 (17456) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/26 13:42:58 (17456) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/26 13:42:58 (17456) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/26 13:43:09 (17457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:45:39 (17470) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:47:59 (17484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/26 13:47:59 (17484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/26 13:47:59 (17484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/26 13:48:24 (17505) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:49:24 (17522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:49:25 (17528) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:52:44 (17588) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:53:00 (17590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/26 13:53:00 (17590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/26 13:53:00 (17590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/26 13:54:55 (17631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:58:02 (17664) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/26 13:58:02 (17664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/26 13:58:02 (17664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/26 13:58:30 (17668) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 13:59:19 (17730) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:03:02 (17888) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/26 14:03:02 (17888) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/26 14:03:02 (17888) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/26 14:03:17 (17889) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:04:27 (17895) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:07:33 (17910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:08:03 (17917) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/26 14:08:03 (17917) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/26 14:08:03 (17917) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/26 14:09:45 (17940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:13:04 (17979) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/26 14:13:04 (17979) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/26 14:13:04 (17979) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/26 14:13:36 (18000) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:15:06 (18007) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:16:43 (18019) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:18:05 (18032) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/26 14:18:05 (18032) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/26 14:18:05 (18032) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/26 14:20:05 (18060) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:23:06 (18093) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/26 14:23:06 (18093) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/26 14:23:06 (18093) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/26 14:24:31 (18119) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:24:58 (18153) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:27:38 (18184) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:28:07 (18195) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/26 14:28:07 (18195) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/26 14:28:07 (18195) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/26 14:29:07 (18218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:33:08 (18326) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/26 14:33:08 (18326) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/26 14:33:08 (18326) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/26 14:33:43 (18347) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:35:14 (18354) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:37:32 (18368) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:38:09 (18375) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/26 14:38:09 (18375) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/26 14:38:09 (18375) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/26 14:38:59 (18398) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:43:10 (18436) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/26 14:43:10 (18436) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/26 14:43:10 (18436) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/26 14:44:24 (18458) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:46:00 (18467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:47:59 (18481) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:48:11 (18487) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/26 14:48:11 (18487) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/26 14:48:11 (18487) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/26 14:49:33 (18512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:53:12 (18598) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/26 14:53:12 (18598) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/26 14:53:12 (18598) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/26 14:54:22 (18622) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:56:16 (18653) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:58:13 (18686) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/26 14:58:13 (18686) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/26 14:58:13 (18686) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/26 14:58:41 (18710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 14:58:50 (18720) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:03:14 (18892) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/26 15:03:14 (18892) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/26 15:03:14 (18892) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/26 15:04:34 (18914) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:05:59 (18977) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:08:15 (18985) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/26 15:08:15 (18985) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/26 15:08:15 (18985) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/26 15:09:09 (19010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:09:35 (19022) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:13:16 (19058) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/26 15:13:16 (19058) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/26 15:13:16 (19058) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/26 15:14:30 (19080) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:15:53 (19087) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:18:17 (19121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/26 15:18:17 (19121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/26 15:18:17 (19121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/26 15:18:21 (19122) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:19:16 (19135) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:23:18 (19174) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/26 15:23:18 (19174) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/26 15:23:18 (19174) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/26 15:24:54 (19206) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:25:11 (19236) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:28:20 (19262) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/26 15:28:20 (19262) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/26 15:28:20 (19262) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/26 15:29:18 (19287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:30:00 (19300) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:33:20 (19373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/26 15:33:20 (19373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/26 15:33:20 (19373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/26 15:34:24 (19427) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:35:29 (19433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:38:21 (19442) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/26 15:38:21 (19442) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/26 15:38:21 (19442) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/26 15:38:49 (19466) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:39:17 (19479) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:43:22 (19537) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/26 15:43:22 (19537) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/26 15:43:22 (19537) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/26 15:43:42 (19538) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:44:57 (19545) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:48:23 (19574) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/26 15:48:23 (19574) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/26 15:48:23 (19574) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/26 15:48:38 (19575) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:49:39 (19591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:53:24 (19629) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/26 15:53:24 (19629) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/26 15:53:24 (19629) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/26 15:53:49 (19650) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:54:56 (19661) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:58:25 (19716) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/26 15:58:25 (19716) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/26 15:58:25 (19716) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/26 15:58:47 (19740) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 15:59:21 (19753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:03:08 (19875) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:03:26 (19913) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/26 16:03:26 (19913) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/26 16:03:26 (19913) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/26 16:04:59 (19921) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:07:59 (19982) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:08:27 (19994) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/26 16:08:27 (19994) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/26 16:08:27 (19994) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/26 16:10:09 (20019) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:13:28 (20035) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/26 16:13:28 (20035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/26 16:13:28 (20035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/26 16:13:58 (20057) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:14:41 (20062) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:18:29 (20075) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/26 16:18:29 (20075) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/26 16:18:29 (20075) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/26 16:18:50 (20096) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:19:16 (20112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:23:30 (20151) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/26 16:23:30 (20151) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/26 16:23:30 (20151) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/26 16:24:15 (20159) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:24:56 (20186) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:28:31 (20238) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/26 16:28:31 (20238) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/26 16:28:31 (20238) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/26 16:29:21 (20263) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:29:32 (20272) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:33:32 (20311) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/26 16:33:32 (20311) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/26 16:33:32 (20311) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/26 16:33:47 (20315) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:34:29 (20378) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:38:33 (20418) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/26 16:38:33 (20418) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/26 16:38:33 (20418) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/26 16:38:58 (20423) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:40:00 (20454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:43:24 (20514) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:43:30 (20518) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:43:34 (20524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/26 16:43:34 (20524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/26 16:43:34 (20524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/26 16:48:35 (20530) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/26 16:48:35 (20530) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/26 16:48:35 (20530) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/26 16:49:11 (20554) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:49:44 (20566) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:52:57 (20612) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:53:36 (20638) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/26 16:53:36 (20638) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/26 16:53:36 (20638) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/26 16:53:51 (20639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:58:20 (20708) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 16:58:37 (20721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/26 16:58:37 (20721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/26 16:58:37 (20721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/26 17:00:41 (20799) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:03:38 (20832) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/26 17:03:38 (20832) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/26 17:03:38 (20832) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/26 17:03:46 (20856) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:04:08 (20863) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:08:39 (20962) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/26 17:08:39 (20962) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/26 17:08:39 (20962) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/26 17:08:45 (20963) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:10:06 (20997) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:13:28 (21029) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:13:40 (21031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/26 17:13:40 (21031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/26 17:13:40 (21031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/26 17:14:34 (21036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:18:41 (21071) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:18:42 (21080) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/26 17:18:42 (21080) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/26 17:18:42 (21080) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/26 17:19:21 (21089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:23:43 (21127) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/26 17:23:43 (21127) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/26 17:23:43 (21127) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/26 17:24:05 (21149) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:25:09 (21158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:27:57 (21213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:28:44 (21242) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/26 17:28:44 (21242) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/26 17:28:44 (21242) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/26 17:30:04 (21257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:33:45 (21284) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/26 17:33:45 (21284) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/26 17:33:45 (21284) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/26 17:34:58 (21310) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:35:39 (21315) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:37:29 (21379) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:38:46 (21395) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/26 17:38:46 (21395) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/26 17:38:46 (21395) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/26 17:39:03 (21432) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:43:47 (21464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/26 17:43:47 (21464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/26 17:43:47 (21464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/26 17:45:34 (21495) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:45:34 (21496) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:46:48 (21524) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:48:48 (21542) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/26 17:48:48 (21542) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/26 17:48:48 (21542) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/26 17:48:51 (21543) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:53:49 (21582) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/26 17:53:49 (21582) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/26 17:53:49 (21582) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/26 17:55:23 (21591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:56:16 (21642) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:57:15 (21666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 17:58:50 (21697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/26 17:58:50 (21697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/26 17:58:50 (21697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/26 17:59:49 (21724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:03:51 (21804) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/26 18:03:51 (21804) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/26 18:03:51 (21804) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/26 18:05:01 (21813) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:06:57 (21840) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:07:40 (21864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:08:52 (21916) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:08:53 (21922) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/26 18:08:53 (21922) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/26 18:08:53 (21922) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/26 18:13:54 (21984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/26 18:13:54 (21984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/26 18:13:54 (21984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/26 18:14:39 (21989) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:16:41 (22023) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:17:32 (22054) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:18:55 (22060) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/26 18:18:55 (22060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/26 18:18:55 (22060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/26 18:19:10 (22065) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:23:57 (22101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/26 18:23:57 (22101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/26 18:23:57 (22101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/26 18:24:21 (22106) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:27:28 (22182) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:27:35 (22191) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:28:52 (22215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:28:58 (22221) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/26 18:28:58 (22221) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/26 18:28:58 (22221) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/26 18:33:59 (22260) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/26 18:33:59 (22260) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/26 18:33:59 (22260) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/26 18:34:45 (22268) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:36:32 (22296) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:37:27 (22303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:37:45 (22340) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:39:00 (22353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/26 18:39:00 (22353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/26 18:39:00 (22353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/26 18:39:20 (22394) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:44:01 (22464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/26 18:44:01 (22464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/26 18:44:01 (22464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/26 18:44:56 (22468) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:47:27 (22500) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:47:52 (22522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:49:02 (22537) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/26 18:49:02 (22537) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/26 18:49:02 (22537) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/26 18:49:23 (22541) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:54:03 (22582) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/26 18:54:03 (22582) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/26 18:54:03 (22582) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/26 18:54:37 (22589) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:56:38 (22641) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:57:54 (22664) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 18:59:04 (22700) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/26 18:59:04 (22700) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/26 18:59:04 (22700) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/26 19:00:13 (22765) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:03:40 (22810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:04:05 (22817) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/26 19:04:05 (22817) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/26 19:04:05 (22817) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/26 19:06:51 (22847) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:07:00 (22863) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:07:52 (22886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:09:06 (22899) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/26 19:09:06 (22899) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/26 19:09:06 (22899) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/26 19:11:12 (22966) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:12:58 (23010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:14:07 (23018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/26 19:14:07 (23018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/26 19:14:07 (23018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/26 19:17:24 (23072) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:17:27 (23081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:19:08 (23085) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/26 19:19:08 (23085) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/26 19:19:08 (23085) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/26 19:21:36 (23123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:22:34 (23133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:24:09 (23141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/26 19:24:09 (23141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/26 19:24:09 (23141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/26 19:27:15 (23192) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:27:37 (23221) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:29:10 (23245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/26 19:29:10 (23245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/26 19:29:10 (23245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/26 19:30:56 (23263) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:31:38 (23291) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:34:11 (23300) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/26 19:34:11 (23300) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/26 19:34:11 (23300) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/26 19:35:20 (23309) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:36:19 (23346) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:37:28 (23376) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:39:12 (23384) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:39:13 (23384) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 19:39:13 (23384) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 19:39:13 (23384) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 19:40:34 (23396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:42:31 (23463) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:44:13 (23510) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/26 19:44:13 (23510) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/26 19:44:13 (23510) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/26 19:44:32 (23511) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:46:20 (23551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:46:59 (23580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:49:15 (23592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:49:15 (23592) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 19:49:15 (23592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 19:49:15 (23592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 19:50:58 (23607) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:53:24 (23636) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:54:15 (23646) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/26 19:54:15 (23646) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/26 19:54:15 (23646) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/26 19:56:40 (23693) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:57:50 (23723) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:59:16 (23747) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 19:59:16 (23747) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 19:59:16 (23747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 19:59:16 (23747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 20:01:46 (23848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:03:40 (23860) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:04:17 (23867) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/26 20:04:17 (23867) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/26 20:04:17 (23867) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/26 20:06:42 (23913) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:06:58 (23922) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:09:18 (23930) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/26 20:09:18 (23930) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/26 20:09:18 (23930) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/26 20:10:51 (23958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:13:31 (24006) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:14:19 (24018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/26 20:14:19 (24018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/26 20:14:19 (24018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/26 20:16:02 (24072) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:17:30 (24101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:19:20 (24112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/26 20:19:20 (24112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/26 20:19:20 (24112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/26 20:21:25 (24128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:23:52 (24157) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:24:21 (24167) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/26 20:24:21 (24167) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/26 20:24:21 (24167) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/26 20:26:00 (24189) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:28:12 (24241) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:29:22 (24268) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:29:22 (24268) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 20:29:22 (24268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 20:29:22 (24268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 20:31:41 (24303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:33:52 (24314) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:34:23 (24321) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/26 20:34:23 (24321) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/26 20:34:23 (24321) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/26 20:35:18 (24348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:37:56 (24375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:39:24 (24386) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:39:24 (24386) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 20:39:24 (24386) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 20:39:24 (24386) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 20:41:31 (24417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:44:16 (24467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:44:25 (24493) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/26 20:44:25 (24493) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/26 20:44:25 (24493) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/26 20:44:46 (24496) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:48:22 (24560) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:49:26 (24570) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:49:26 (24570) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 20:49:26 (24570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 20:49:26 (24570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 20:51:00 (24606) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:54:06 (24618) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:54:27 (24625) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/26 20:54:27 (24625) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/26 20:54:27 (24625) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/26 20:55:21 (24650) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:57:54 (24701) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:59:28 (24715) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 20:59:28 (24715) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 20:59:28 (24715) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 20:59:28 (24715) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 21:01:43 (24816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:03:31 (24842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:04:29 (24849) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/26 21:04:29 (24849) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/26 21:04:29 (24849) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/26 21:05:32 (24871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:08:18 (24902) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:09:30 (24912) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/26 21:09:30 (24912) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/26 21:09:30 (24912) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/26 21:11:46 (24926) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:13:49 (24952) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:14:31 (24959) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/26 21:14:32 (24959) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/26 21:14:32 (24959) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/26 21:15:37 (25020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:17:24 (25086) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:19:32 (25097) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/26 21:19:32 (25097) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/26 21:19:32 (25097) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/26 21:21:18 (25112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:24:33 (25140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/26 21:24:33 (25140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/26 21:24:33 (25140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/26 21:24:50 (25144) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:25:51 (25171) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:26:45 (25194) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:29:34 (25236) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/26 21:29:34 (25236) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/26 21:29:34 (25236) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/26 21:30:21 (25263) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:34:35 (25292) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/26 21:34:35 (25292) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/26 21:34:35 (25292) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/26 21:34:58 (25296) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:35:57 (25326) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:36:51 (25356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:39:36 (25366) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/26 21:39:36 (25366) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/26 21:39:36 (25366) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/26 21:40:19 (25375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:44:37 (25406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/26 21:44:37 (25406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/26 21:44:37 (25406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/26 21:45:22 (25413) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:45:50 (25439) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:47:21 (25514) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:49:38 (25552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:49:38 (25552) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 21:49:38 (25552) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 21:49:38 (25552) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 21:51:01 (25563) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:54:39 (25592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/26 21:54:39 (25592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/26 21:54:39 (25592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/26 21:55:28 (25614) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:55:39 (25626) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:58:11 (25685) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:59:40 (25691) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 21:59:40 (25691) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 21:59:40 (25691) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 21:59:40 (25691) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 21:59:59 (25711) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:04:41 (25816) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/26 22:04:41 (25816) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/26 22:04:41 (25816) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/26 22:05:59 (25845) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:06:04 (25851) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:07:27 (25885) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:09:42 (25889) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/26 22:09:42 (25889) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/26 22:09:42 (25889) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/26 22:10:59 (25899) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:14:43 (25927) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/26 22:14:43 (25927) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/26 22:14:43 (25927) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/26 22:16:23 (25960) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:16:30 (25969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:16:58 (26001) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:19:44 (26076) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/26 22:19:44 (26076) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/26 22:19:44 (26076) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/26 22:21:55 (26104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:24:45 (26116) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/26 22:24:45 (26116) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/26 22:24:45 (26116) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/26 22:25:58 (26144) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:26:31 (26174) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:26:59 (26179) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:29:46 (26215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/26 22:29:46 (26215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/26 22:29:46 (26215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/26 22:31:06 (26243) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:34:47 (26271) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:34:48 (26271) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 22:34:48 (26271) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 22:34:48 (26271) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 22:35:31 (26301) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:36:38 (26327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:36:40 (26336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:39:48 (26346) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/26 22:39:48 (26346) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/26 22:39:48 (26346) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/26 22:40:21 (26355) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:44:49 (26392) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:44:50 (26392) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 22:44:50 (26392) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 22:44:50 (26392) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 22:45:35 (26416) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:46:47 (26447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:46:56 (26453) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:49:50 (26507) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/26 22:49:50 (26507) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/26 22:49:50 (26507) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/26 22:49:53 (26508) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:54:51 (26626) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:54:51 (26626) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 22:54:51 (26626) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 22:54:51 (26626) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 22:55:32 (26650) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:56:50 (26656) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:57:32 (26710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 22:59:52 (26740) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/26 22:59:52 (26740) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/26 22:59:52 (26740) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/26 23:00:23 (26812) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:04:53 (26850) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/26 23:04:53 (26850) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/26 23:04:53 (26850) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/26 23:06:09 (26929) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:06:46 (26952) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:07:42 (26975) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:09:54 (27002) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/26 23:09:54 (27002) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/26 23:09:54 (27002) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/26 23:10:40 (27011) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:14:55 (27029) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:14:55 (27029) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 23:14:55 (27029) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 23:14:55 (27029) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 23:15:46 (27053) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:16:11 (27075) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:18:34 (27096) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:19:56 (27154) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/26 23:19:56 (27154) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/26 23:19:56 (27154) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/26 23:21:36 (27199) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:24:57 (27216) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:24:57 (27216) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 23:24:57 (27216) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 23:24:57 (27216) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 23:25:32 (27240) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:26:31 (27270) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:29:23 (27305) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:29:58 (27315) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/26 23:29:58 (27315) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/26 23:29:58 (27315) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/26 23:31:15 (27357) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:34:59 (27373) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:34:59 (27373) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 23:34:59 (27373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 23:34:59 (27373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 23:36:09 (27397) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:37:17 (27428) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:38:49 (27434) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:40:00 (27460) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/26 23:40:00 (27460) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/26 23:40:00 (27460) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/26 23:40:31 (27469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:45:01 (27489) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/26 23:45:01 (27489) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/26 23:45:01 (27489) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/26 23:46:43 (27535) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:47:00 (27544) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:48:54 (27553) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:49:40 (27582) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:50:02 (27592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/26 23:50:02 (27592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/26 23:50:02 (27592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/26 23:55:03 (27683) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:55:04 (27683) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/26 23:55:04 (27683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/26 23:55:04 (27683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/26 23:56:56 (27731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:57:12 (27733) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/26 23:58:57 (27786) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:00:04 (27852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/27 00:00:04 (27852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/27 00:00:04 (27852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/27 00:00:05 (27853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:05:05 (27911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:05:06 (27911) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/27 00:05:06 (27911) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/27 00:05:06 (27911) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/27 00:05:57 (27935) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:06:22 (27958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:08:52 (27991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:09:11 (28000) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:10:06 (28026) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/27 00:10:06 (28026) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/27 00:10:06 (28026) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/27 00:15:07 (28037) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:15:07 (28037) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/27 00:15:07 (28037) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/27 00:15:07 (28037) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/27 00:16:08 (28061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:16:43 (28094) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:18:36 (28104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:20:02 (28136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:20:08 (28142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/27 00:20:08 (28142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/27 00:20:08 (28142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/27 00:23:35 (28195) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:25:09 (28244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:25:09 (28244) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/27 00:25:09 (28244) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/27 00:25:09 (28244) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/27 00:26:52 (28289) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:27:03 (28301) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:28:29 (28332) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:29:19 (28357) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:30:10 (28370) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/27 00:30:10 (28370) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/27 00:30:10 (28370) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/27 00:35:11 (28401) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:35:11 (28401) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/27 00:35:11 (28401) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/27 00:35:11 (28401) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/27 00:35:55 (28425) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:36:23 (28455) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:39:26 (28469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:39:57 (28494) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:40:12 (28504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/27 00:40:12 (28504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/27 00:40:12 (28504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/27 00:45:13 (28521) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/27 00:45:13 (28521) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/27 00:45:13 (28521) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/27 00:46:33 (28564) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:46:34 (28573) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:48:32 (28586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:49:44 (28601) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:50:14 (28611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/27 00:50:14 (28611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/27 00:50:14 (28611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/27 00:55:15 (28705) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/27 00:55:15 (28705) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/27 00:55:15 (28705) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/27 00:56:14 (28729) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:57:10 (28752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:58:35 (28801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 00:59:31 (28812) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:00:16 (28873) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/27 01:00:16 (28873) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/27 01:00:16 (28873) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/27 01:05:24 (28997) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/27 01:05:24 (28997) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/27 01:05:24 (28997) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/27 01:06:04 (29139) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:06:13 (29148) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:06:21 (29158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:06:23 (29160) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:10:25 (29187) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/27 01:10:25 (29187) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/27 01:10:25 (29187) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/27 01:15:19 (29233) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:15:26 (29243) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/27 01:15:26 (29243) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/27 01:15:26 (29243) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/27 01:15:52 (29264) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:16:15 (29270) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:16:49 (29286) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:19:59 (29299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:20:27 (29320) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/27 01:20:27 (29320) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/27 01:20:27 (29320) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/27 01:24:25 (29386) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:25:15 (29424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:25:19 (29455) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:25:28 (29459) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/27 01:25:28 (29459) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/27 01:25:28 (29459) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/27 01:25:50 (29466) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:26:59 (29510) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:30:29 (29549) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/27 01:30:29 (29549) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/27 01:30:29 (29549) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/27 01:34:03 (29578) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:35:03 (29639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:35:15 (29648) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:35:30 (29651) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/27 01:35:30 (29651) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/27 01:35:30 (29651) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/27 01:36:35 (29673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:37:18 (29691) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:37:58 (29702) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:40:31 (29727) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/27 01:40:31 (29727) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/27 01:40:31 (29727) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/27 01:44:38 (29759) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:45:32 (29769) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/27 01:45:32 (29769) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/27 01:45:32 (29769) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/27 01:45:55 (29790) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:46:58 (29814) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:47:20 (29823) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:50:33 (29837) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/27 01:50:33 (29837) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/27 01:50:33 (29837) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/27 01:54:44 (29866) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:55:10 (29897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:55:34 (29951) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/27 01:55:34 (29951) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/27 01:55:34 (29951) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/27 01:56:34 (29958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 01:57:25 (30002) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:00:35 (30086) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/27 02:00:35 (30086) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/27 02:00:35 (30086) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/27 02:04:17 (30155) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:04:45 (30181) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:05:36 (30193) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/27 02:05:36 (30193) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/27 02:05:36 (30193) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/27 02:06:40 (30217) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:07:33 (30230) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:10:38 (30245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/27 02:10:38 (30245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/27 02:10:38 (30245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/27 02:14:32 (30277) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:15:04 (30301) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:15:38 (30311) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/27 02:15:38 (30311) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/27 02:15:38 (30311) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/27 02:16:30 (30331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:16:57 (30342) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:20:39 (30359) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/27 02:20:39 (30359) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/27 02:20:39 (30359) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/27 02:23:32 (30387) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:24:40 (30413) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:25:40 (30423) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/27 02:25:40 (30423) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/27 02:25:40 (30423) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/27 02:26:02 (30427) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:27:07 (30473) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:30:41 (30624) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/27 02:30:41 (30624) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/27 02:30:41 (30624) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/27 02:33:43 (30675) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:34:28 (30708) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:35:42 (30714) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/27 02:35:42 (30714) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/27 02:35:42 (30714) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/27 02:35:47 (30715) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:37:47 (30726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:40:43 (30764) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/27 02:40:43 (30764) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/27 02:40:43 (30764) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/27 02:44:19 (30791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:44:43 (30814) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:45:01 (30826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:45:44 (30833) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/27 02:45:44 (30833) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/27 02:45:44 (30833) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/27 02:47:34 (30839) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:50:45 (30869) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/27 02:50:45 (30869) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/27 02:50:45 (30869) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/27 02:54:34 (30920) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:54:39 (30922) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:55:15 (30934) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 02:55:46 (30941) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/27 02:55:46 (30941) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/27 02:55:46 (30941) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/27 02:57:55 (30983) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:00:47 (31105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/27 03:00:47 (31105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/27 03:00:47 (31105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/27 03:04:05 (31172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:04:27 (31197) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:04:52 (31209) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:05:48 (31216) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/27 03:05:48 (31216) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/27 03:05:48 (31216) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/27 03:08:46 (31237) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:10:49 (31269) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/27 03:10:49 (31269) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/27 03:10:49 (31269) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/27 03:13:29 (31298) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:14:42 (31326) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:15:44 (31339) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:15:50 (31345) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/27 03:15:50 (31345) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/27 03:15:50 (31345) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/27 03:19:23 (31358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:20:51 (31385) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/27 03:20:51 (31385) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/27 03:20:51 (31385) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/27 03:22:52 (31770) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:25:08 (31798) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:25:32 (31811) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:25:52 (31817) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/27 03:25:52 (31817) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/27 03:25:52 (31817) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/27 03:29:49 (31903) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:30:54 (31949) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/27 03:30:54 (31949) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/27 03:30:54 (31949) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/27 03:33:31 (31997) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:34:35 (32004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:34:59 (32030) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:35:55 (32042) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/27 03:35:55 (32042) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/27 03:35:55 (32042) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/27 03:39:33 (32070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:40:56 (32081) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/27 03:40:56 (32081) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/27 03:40:56 (32081) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/27 03:44:32 (32129) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:44:48 (32134) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:44:59 (32146) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:45:57 (32153) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/27 03:45:57 (32153) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/27 03:45:57 (32153) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/27 03:48:36 (32160) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:50:58 (32189) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/27 03:50:58 (32189) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/27 03:50:58 (32189) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/27 03:53:36 (32216) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:55:19 (32245) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:55:21 (32251) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 03:55:59 (32261) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/27 03:55:59 (32261) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/27 03:55:59 (32261) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/27 03:58:34 (32283) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:01:00 (32410) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/27 04:01:00 (32410) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/27 04:01:00 (32410) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/27 04:03:13 (32501) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:04:36 (32527) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:05:44 (32540) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:06:01 (32547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/27 04:06:01 (32547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/27 04:06:01 (32547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/27 04:09:10 (32576) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:11:02 (32588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/27 04:11:02 (32588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/27 04:11:02 (32588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/27 04:12:30 (32612) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:14:19 (32643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:15:29 (32658) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:16:03 (32666) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/27 04:16:03 (32666) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/27 04:16:03 (32666) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/27 04:20:05 (32699) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:21:04 (32706) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/27 04:21:04 (32706) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/27 04:21:04 (32706) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/27 04:22:40 (32729) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:24:31 (32755) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:25:29 (302) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:26:05 (312) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/27 04:26:05 (312) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/27 04:26:05 (312) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/27 04:30:31 (370) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:31:06 (377) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/27 04:31:06 (377) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/27 04:31:06 (377) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/27 04:33:29 (515) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:33:33 (518) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:35:43 (535) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:36:07 (541) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/27 04:36:07 (541) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/27 04:36:07 (541) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/27 04:39:52 (571) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:41:08 (582) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/27 04:41:08 (582) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/27 04:41:08 (582) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/27 04:43:18 (609) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:43:59 (639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:45:09 (645) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:46:09 (655) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/27 04:46:09 (655) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/27 04:46:09 (655) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/27 04:50:06 (685) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:51:10 (692) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/27 04:51:10 (692) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/27 04:51:10 (692) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/27 04:53:17 (718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:54:21 (748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:56:04 (757) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 04:56:11 (763) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/27 04:56:11 (763) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/27 04:56:11 (763) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/27 04:59:29 (816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:01:12 (898) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/27 05:01:12 (898) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/27 05:01:12 (898) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/27 05:03:58 (981) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:05:10 (1047) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:05:10 (1048) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:06:13 (1056) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/27 05:06:13 (1056) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/27 05:06:13 (1056) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/27 05:09:05 (1069) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:11:14 (1100) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/27 05:11:14 (1100) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/27 05:11:14 (1100) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/27 05:14:10 (1132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:15:23 (1169) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:16:07 (1183) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:16:15 (1189) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/27 05:16:15 (1189) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/27 05:16:15 (1189) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/27 05:19:02 (1201) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:21:16 (1228) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/27 05:21:16 (1228) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/27 05:21:16 (1228) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/27 05:23:48 (1263) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:24:46 (1295) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:25:37 (1302) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:26:17 (1310) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/27 05:26:17 (1310) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/27 05:26:17 (1310) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/27 05:28:16 (1318) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:31:18 (1379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/27 05:31:18 (1379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/27 05:31:18 (1379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/27 05:33:15 (1426) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:35:00 (1506) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:35:15 (1512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:36:19 (1563) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/27 05:36:19 (1563) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/27 05:36:19 (1563) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/27 05:38:04 (1569) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:41:20 (1604) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/27 05:41:20 (1604) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/27 05:41:20 (1604) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/27 05:43:15 (1627) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:44:19 (1664) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:44:38 (1671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:46:21 (1680) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/27 05:46:21 (1680) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/27 05:46:21 (1680) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/27 05:48:49 (1690) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:51:22 (1721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/27 05:51:22 (1721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/27 05:51:22 (1721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/27 05:53:35 (1744) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:53:57 (1774) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:54:35 (1779) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 05:56:23 (1792) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/27 05:56:23 (1792) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/27 05:56:23 (1792) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/27 05:58:42 (1801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:01:24 (1943) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/27 06:01:24 (1943) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/27 06:01:24 (1943) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/27 06:03:41 (1990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:04:31 (2020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:05:21 (2068) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:06:25 (2077) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/27 06:06:25 (2077) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/27 06:06:25 (2077) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/27 06:08:46 (2126) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:11:26 (2167) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/27 06:11:26 (2167) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/27 06:11:26 (2167) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/27 06:13:37 (2194) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:14:41 (2226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:14:56 (2236) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:16:28 (2245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/27 06:16:28 (2245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/27 06:16:28 (2245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/27 06:19:38 (2266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:21:28 (2295) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/27 06:21:28 (2295) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/27 06:21:28 (2295) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/27 06:23:56 (2325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:25:01 (2342) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:25:39 (2369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:26:29 (2371) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/27 06:26:29 (2371) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/27 06:26:29 (2371) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/27 06:29:15 (2396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:31:30 (2435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/27 06:31:30 (2435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/27 06:31:30 (2435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/27 06:33:00 (2481) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:34:40 (2516) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:34:46 (2522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:36:31 (2564) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/27 06:36:31 (2564) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/27 06:36:31 (2564) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/27 06:39:46 (2624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:41:32 (2641) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/27 06:41:32 (2641) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/27 06:41:32 (2641) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/27 06:43:09 (2665) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:44:32 (2701) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:44:42 (2708) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:46:33 (2712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/27 06:46:33 (2712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/27 06:46:33 (2712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/27 06:49:05 (2721) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:51:34 (2751) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/27 06:51:34 (2751) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/27 06:51:34 (2751) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/27 06:53:05 (2822) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:53:50 (2835) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:55:31 (2866) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 06:56:35 (2869) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/27 06:56:35 (2869) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/27 06:56:35 (2869) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/27 06:58:50 (2879) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:01:36 (3000) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/27 07:01:36 (3000) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/27 07:01:36 (3000) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/27 07:02:40 (3040) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:04:25 (3059) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:05:19 (3093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:05:24 (3109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:06:37 (3112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/27 07:06:37 (3112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/27 07:06:37 (3112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/27 07:09:38 (3256) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:11:38 (3268) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/27 07:11:38 (3268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/27 07:11:38 (3268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/27 07:12:41 (3296) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:15:03 (3331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:15:22 (3336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:16:39 (3348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/27 07:16:39 (3348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/27 07:16:39 (3348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/27 07:19:25 (3358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:21:21 (3389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:21:40 (3405) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/27 07:21:40 (3405) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/27 07:21:40 (3405) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/27 07:23:29 (3433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:24:02 (3463) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:24:25 (3471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:26:41 (3481) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/27 07:26:41 (3481) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/27 07:26:41 (3481) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/27 07:28:27 (3488) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:31:42 (3543) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/27 07:31:42 (3543) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/27 07:31:42 (3543) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/27 07:33:53 (3593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:33:59 (3602) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:34:23 (3629) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:36:43 (3637) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/27 07:36:43 (3637) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/27 07:36:43 (3637) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/27 07:38:10 (3648) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:41:44 (3742) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/27 07:41:44 (3742) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/27 07:41:44 (3742) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/27 07:41:50 (3743) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:43:01 (3763) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:43:36 (3791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:44:43 (3818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:46:45 (3829) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/27 07:46:45 (3829) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/27 07:46:45 (3829) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/27 07:47:42 (3833) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:51:47 (3866) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/27 07:51:47 (3866) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/27 07:51:47 (3866) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/27 07:53:06 (3871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:54:26 (3902) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:54:57 (3927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:55:41 (3940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 07:56:48 (3961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/27 07:56:48 (3961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/27 07:56:48 (3961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/27 07:56:52 (3962) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:01:49 (4087) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/27 08:01:49 (4087) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/27 08:01:49 (4087) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/27 08:02:34 (4091) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:04:21 (4168) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:04:30 (4177) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:06:50 (4182) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/27 08:06:50 (4182) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/27 08:06:50 (4182) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/27 08:07:01 (4186) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:11:51 (4284) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/27 08:11:51 (4284) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/27 08:11:51 (4284) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/27 08:12:45 (4289) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:13:32 (4319) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:14:05 (4353) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:16:52 (4362) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/27 08:16:52 (4362) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/27 08:16:52 (4362) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/27 08:17:08 (4366) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:21:53 (4398) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/27 08:21:53 (4398) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/27 08:21:53 (4398) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/27 08:22:35 (4424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:22:38 (4433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:24:16 (4467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:26:11 (4479) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:26:54 (4486) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/27 08:26:54 (4486) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/27 08:26:54 (4486) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/27 08:31:55 (4537) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/27 08:31:55 (4537) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/27 08:31:55 (4537) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/27 08:32:20 (4541) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:32:47 (4571) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:34:03 (4621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:36:14 (4633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:36:56 (4640) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/27 08:36:56 (4640) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/27 08:36:56 (4640) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/27 08:41:47 (4708) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:41:57 (4714) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/27 08:41:57 (4714) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/27 08:41:57 (4714) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/27 08:42:22 (4735) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:44:18 (4794) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:46:18 (4801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:46:58 (4810) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/27 08:46:58 (4810) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/27 08:46:58 (4810) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/27 08:51:59 (4835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/27 08:51:59 (4835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/27 08:51:59 (4835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/27 08:52:12 (4859) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:52:17 (4865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:53:42 (4898) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:55:25 (4910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 08:57:00 (4921) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/27 08:57:00 (4921) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/27 08:57:00 (4921) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/27 09:02:01 (5037) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/27 09:02:01 (5037) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/27 09:02:01 (5037) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/27 09:02:32 (5041) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:03:17 (5108) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:03:27 (5117) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:05:37 (5135) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:07:02 (5146) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/27 09:07:02 (5146) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/27 09:07:02 (5146) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/27 09:12:04 (5174) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/27 09:12:04 (5174) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/27 09:12:04 (5174) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/27 09:12:45 (5235) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:13:00 (5242) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:14:06 (5287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:16:34 (5304) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:17:04 (5314) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/27 09:17:04 (5314) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/27 09:17:04 (5314) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/27 09:22:05 (5364) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:22:06 (5366) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/27 09:22:06 (5366) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/27 09:22:06 (5366) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/27 09:23:43 (5374) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:24:16 (5406) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:25:43 (5421) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:27:07 (5431) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/27 09:27:07 (5431) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/27 09:27:07 (5431) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/27 09:31:37 (5501) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:32:08 (5504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/27 09:32:08 (5504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/27 09:32:08 (5504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/27 09:33:22 (5512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:34:37 (5563) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:36:07 (5578) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:37:09 (5589) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/27 09:37:09 (5589) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/27 09:37:09 (5589) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/27 09:42:10 (5617) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/27 09:42:10 (5617) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/27 09:42:10 (5617) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/27 09:42:33 (5638) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:42:51 (5647) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:43:55 (5714) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:46:59 (5752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:47:11 (5758) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/27 09:47:11 (5758) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/27 09:47:11 (5758) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/27 09:52:12 (5786) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/27 09:52:12 (5786) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/27 09:52:12 (5786) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/27 09:53:17 (5811) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:53:48 (5841) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:53:48 (5842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:56:55 (5865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 09:57:13 (5871) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/27 09:57:13 (5871) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/27 09:57:13 (5871) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/27 10:02:14 (5991) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/27 10:02:14 (5991) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/27 10:02:14 (5991) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/27 10:03:26 (6016) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:03:40 (6036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:04:49 (6070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:06:53 (6085) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:07:15 (6091) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/27 10:07:15 (6091) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/27 10:07:15 (6091) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/27 10:12:16 (6146) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/27 10:12:16 (6146) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/27 10:12:16 (6146) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/27 10:12:29 (6149) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:14:06 (6160) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:15:11 (6222) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:16:19 (6276) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:17:17 (6286) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/27 10:17:17 (6286) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/27 10:17:17 (6286) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/27 10:22:18 (6317) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/27 10:22:18 (6317) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/27 10:22:18 (6317) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/27 10:22:59 (6391) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:24:15 (6415) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:24:31 (6427) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:25:53 (6441) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:27:19 (6452) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/27 10:27:19 (6452) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/27 10:27:19 (6452) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/27 10:32:20 (6524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/27 10:32:20 (6524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/27 10:32:20 (6524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/27 10:32:21 (6525) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:34:18 (6574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:35:09 (6587) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:36:15 (6597) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:37:21 (6607) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/27 10:37:21 (6607) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/27 10:37:21 (6607) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/27 10:42:22 (6639) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/27 10:42:22 (6639) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/27 10:42:22 (6639) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/27 10:42:55 (6664) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:43:50 (6686) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:44:38 (6699) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:47:02 (6752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:47:23 (6780) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/27 10:47:23 (6780) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/27 10:47:23 (6780) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/27 10:52:24 (6814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/27 10:52:24 (6814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/27 10:52:24 (6814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/27 10:53:31 (6836) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:53:42 (6841) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:54:22 (6868) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:56:04 (6973) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/27 10:56:04 (6973) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/27 10:56:04 (6973) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/27 10:56:19 (7105) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:56:32 (7136) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/27 10:56:32 (7136) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/27 10:56:32 (7136) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/27 10:56:57 (7254) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:57:00 (7256) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:57:00 (7257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:57:21 (7303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:58:12 (7388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/27 10:58:12 (7388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/27 10:58:12 (7388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/27 10:58:42 (7480) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/27 10:58:42 (7480) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/27 10:58:42 (7480) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/27 10:59:17 (7567) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:59:31 (7582) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:59:36 (7588) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:59:40 (7609) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 10:59:58 (7643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:00:08 (7703) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:03:43 (7793) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/27 11:03:43 (7793) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/27 11:03:43 (7793) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/27 11:04:47 (7821) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:05:14 (7937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:08:30 (8012) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:08:44 (8021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/27 11:08:44 (8021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/27 11:08:44 (8021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/27 11:09:29 (8112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:09:35 (8130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:09:37 (8136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:09:48 (8148) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:09:54 (8155) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:13:45 (8191) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/27 11:13:45 (8191) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/27 11:13:45 (8191) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/27 11:14:01 (8193) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:14:31 (8213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:17:40 (8282) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:18:34 (8340) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:18:45 (8356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:18:46 (8365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/27 11:18:46 (8365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/27 11:18:46 (8365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/27 11:19:08 (8374) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:19:23 (8380) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:20:27 (8420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:23:04 (8435) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:23:47 (8454) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/27 11:23:47 (8454) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/27 11:23:47 (8454) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/27 11:24:15 (8458) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:27:04 (8483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:27:45 (8499) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:28:14 (8536) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:28:48 (8552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:28:49 (8558) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/27 11:28:49 (8558) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/27 11:28:49 (8558) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/27 11:29:07 (8561) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:29:46 (8580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:32:49 (8643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:33:50 (8667) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/27 11:33:50 (8667) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/27 11:33:50 (8667) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/27 11:33:55 (8669) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:36:54 (8708) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:38:06 (8731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:38:11 (8747) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:38:44 (8779) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:38:51 (8790) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/27 11:38:51 (8790) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/27 11:38:51 (8790) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/27 11:39:13 (8792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:40:13 (8832) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:42:59 (8848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:43:52 (8867) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/27 11:43:52 (8867) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/27 11:43:52 (8867) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/27 11:44:44 (8870) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:47:23 (8894) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:48:12 (8937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:48:15 (8953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:48:26 (8962) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:48:53 (9010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/27 11:48:53 (9010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/27 11:48:53 (9010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/27 11:49:10 (9012) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:50:57 (9075) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:53:03 (9090) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:53:40 (9110) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:53:54 (9126) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/27 11:53:54 (9126) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/27 11:53:54 (9126) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/27 11:57:44 (9158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:58:03 (9171) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:58:21 (9194) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:58:29 (9203) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:58:45 (9222) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 11:58:55 (9243) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/27 11:58:55 (9243) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/27 11:58:55 (9243) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/27 12:00:38 (9303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:03:27 (9363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:03:53 (9380) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:03:56 (9400) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/27 12:03:56 (9400) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/27 12:03:56 (9400) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/27 12:08:19 (9436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:08:22 (9473) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:08:38 (9482) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:08:46 (9494) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:08:54 (9510) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:08:57 (9517) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/27 12:08:57 (9517) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/27 12:08:57 (9517) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/27 12:11:09 (9551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:13:32 (9568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:13:58 (9586) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/27 12:13:58 (9586) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/27 12:13:58 (9586) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/27 12:13:59 (9587) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:17:50 (9637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:17:53 (9646) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:18:30 (9666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:18:57 (9705) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:18:59 (9721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/27 12:18:59 (9721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/27 12:18:59 (9721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/27 12:19:01 (9722) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:21:10 (9795) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:23:13 (9813) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:23:38 (9830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:24:00 (9847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/27 12:24:00 (9847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/27 12:24:00 (9847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/27 12:27:12 (9874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:28:09 (9898) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:28:20 (9905) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:28:38 (9940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:29:01 (9951) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/27 12:29:01 (9951) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/27 12:29:01 (9951) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/27 12:29:12 (9952) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:31:55 (10005) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:33:23 (10055) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:33:50 (10066) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:34:03 (10075) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/27 12:34:03 (10075) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/27 12:34:03 (10075) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/27 12:37:00 (10120) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:37:50 (10141) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:37:56 (10150) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:38:28 (10174) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:38:34 (10190) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:39:04 (10212) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/27 12:39:04 (10212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/27 12:39:04 (10212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/27 12:41:42 (10226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:42:43 (10241) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:43:38 (10262) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:44:05 (10279) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/27 12:44:05 (10279) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/27 12:44:05 (10279) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/27 12:47:23 (10308) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:48:04 (10325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:48:24 (10347) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:48:41 (10375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:48:52 (10381) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:49:06 (10398) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/27 12:49:06 (10398) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/27 12:49:06 (10398) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/27 12:51:17 (10450) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:53:04 (10558) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:53:42 (10570) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:54:07 (10609) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/27 12:54:07 (10609) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/27 12:54:07 (10609) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/27 12:56:44 (10695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:57:44 (10729) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:58:23 (10753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:58:32 (10765) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:58:38 (10781) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 12:59:08 (10788) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/27 12:59:08 (10788) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/27 12:59:08 (10788) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/27 13:00:46 (10846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:02:37 (10903) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:03:54 (10925) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:04:09 (10942) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/27 13:04:09 (10942) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/27 13:04:09 (10942) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/27 13:06:54 (11004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:08:00 (11028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:08:06 (11045) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:08:30 (11057) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:08:37 (11073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:09:10 (11080) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/27 13:09:10 (11080) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/27 13:09:10 (11080) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/27 13:10:56 (11093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:12:31 (11112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:13:23 (11130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:14:11 (11147) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/27 13:14:11 (11147) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/27 13:14:11 (11147) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/27 13:16:26 (11172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:17:08 (11207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:18:06 (11230) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:18:17 (11249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:19:01 (11262) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:19:12 (11268) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/27 13:19:12 (11268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/27 13:19:12 (11268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/27 13:20:54 (11277) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:21:58 (11294) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:23:06 (11363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:24:13 (11380) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/27 13:24:13 (11380) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/27 13:24:13 (11380) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/27 13:25:41 (11404) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:27:02 (11437) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:28:05 (11460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:28:16 (11479) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:28:58 (11491) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:29:14 (11498) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/27 13:29:14 (11498) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/27 13:29:14 (11498) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/27 13:29:58 (11502) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:32:11 (11547) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:33:06 (11568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:34:15 (11585) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/27 13:34:15 (11585) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/27 13:34:15 (11585) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/27 13:34:56 (11623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:37:40 (11666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:38:01 (11687) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:38:07 (11693) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:39:07 (11713) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:39:16 (11722) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/27 13:39:16 (11722) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/27 13:39:16 (11722) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/27 13:40:57 (11736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:42:26 (11754) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:42:54 (11774) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:44:17 (11793) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/27 13:44:17 (11793) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/27 13:44:17 (11793) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/27 13:45:02 (11815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:47:42 (11851) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:48:08 (11872) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:48:33 (11891) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:49:18 (11898) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/27 13:49:18 (11898) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/27 13:49:18 (11898) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/27 13:49:59 (11902) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:50:36 (11919) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:52:16 (11940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:52:42 (11957) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:54:19 (12032) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/27 13:54:19 (12032) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/27 13:54:19 (12032) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/27 13:55:54 (12054) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:57:04 (12090) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:57:31 (12110) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:58:26 (12130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 13:59:20 (12137) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/27 13:59:20 (12137) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/27 13:59:20 (12137) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/27 14:00:46 (12195) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:01:14 (12231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:01:43 (12241) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:02:10 (12259) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:04:22 (12301) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/27 14:04:22 (12301) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/27 14:04:22 (12301) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/27 14:06:03 (12366) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:06:28 (12379) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:07:02 (12399) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:08:39 (12420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:09:22 (12430) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/27 14:09:22 (12430) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/27 14:09:22 (12430) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/27 14:10:57 (12446) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:11:01 (12454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:11:22 (12467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:12:13 (12488) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:14:23 (12508) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/27 14:14:23 (12508) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/27 14:14:23 (12508) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/27 14:15:56 (12552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:16:17 (12562) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:16:53 (12587) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:18:11 (12608) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:19:24 (12615) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/27 14:19:24 (12615) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/27 14:19:24 (12615) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/27 14:20:28 (12624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:21:27 (12640) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:22:05 (12652) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:23:06 (12673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:24:25 (12728) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/27 14:24:25 (12728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/27 14:24:25 (12728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/27 14:25:14 (12753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:27:32 (12814) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:27:59 (12834) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:28:03 (12851) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:29:26 (12859) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/27 14:29:26 (12859) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/27 14:29:26 (12859) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/27 14:31:22 (12872) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:31:23 (12881) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:32:15 (12897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:33:07 (12940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:34:25 (12977) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:34:27 (12986) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/27 14:34:27 (12986) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/27 14:34:27 (12986) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/27 14:37:43 (13040) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:38:29 (13061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:38:36 (13067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:39:28 (13084) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/27 14:39:28 (13084) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/27 14:39:28 (13084) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/27 14:40:25 (13093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:41:22 (13103) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:42:12 (13121) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:43:12 (13144) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:44:29 (13186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/27 14:44:29 (13186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/27 14:44:29 (13186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/27 14:44:42 (13187) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:47:18 (13223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:48:18 (13244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:49:29 (13264) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:49:30 (13270) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/27 14:49:30 (13270) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/27 14:49:30 (13270) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/27 14:51:21 (13282) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:51:58 (13296) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:52:10 (13335) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:53:18 (13429) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:54:08 (13460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:54:31 (13472) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/27 14:54:31 (13472) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/27 14:54:31 (13472) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/27 14:57:19 (13558) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:58:43 (13588) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:59:09 (13634) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 14:59:32 (13640) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/27 14:59:32 (13640) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/27 14:59:32 (13640) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/27 14:59:51 (13681) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/27 14:59:51 (13681) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/27 14:59:51 (13681) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/27 14:59:59 (13682) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4d347c8)', 'HASH(0x4d2e090)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4d347c8)', 'HASH(0x4d2e090)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4d347c8)', 'HASH(0x4d4cb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4d...', 'HASH(0x4d4c9f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4445b10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4d347c8)', 'HASH(0x4d44ca0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4d347c8)', 'HASH(0x4d44ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4d240c8)', 'handle_results', 'CODE(0x444b190)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4d190e8)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/04/27 15:00:04 (13843) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 15:00:12 (13855) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 15:00:31 (13922) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/27 15:00:31 (13922) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/27 15:00:31 (13922) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/27 15:00:31 (13924) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 15:01:14 (14045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/27 15:01:14 (14045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/27 15:01:14 (14045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/27 15:01:36 (14043) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5731aa0)', 'HASH(0x571d358)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5731aa0)', 'HASH(0x571d358)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5731aa0)', 'HASH(0x574bb40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4e...', 'HASH(0x56dcae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x574b8b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5731aa0)', 'HASH(0x5743c80)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5731aa0)', 'HASH(0x5743c80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x57246b0)', 'handle_results', 'CODE(0x4e4f160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x571d160)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/04/27 15:01:52 (14163) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/27 15:01:52 (14163) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/27 15:01:52 (14163) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/27 15:02:53 (14271) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 15:03:19 (14283) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 15:06:53 (14381) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/27 15:06:53 (14381) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/27 15:06:53 (14381) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/27 15:11:54 (14464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/27 15:11:54 (14464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/27 15:11:54 (14464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/27 15:16:55 (14480) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/27 15:16:55 (14480) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/27 15:16:55 (14480) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/27 15:21:56 (14495) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/27 15:21:56 (14495) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/27 15:21:56 (14495) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/27 15:26:57 (14547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/27 15:26:58 (14547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/27 15:26:58 (14547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/27 15:31:50 (14586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 15:31:58 (14602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/27 15:31:58 (14602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/27 15:31:58 (14602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/27 15:33:34 (14633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 15:36:59 (14681) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/27 15:36:59 (14681) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/27 15:36:59 (14681) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/27 15:42:00 (14695) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/27 15:42:00 (14695) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/27 15:42:00 (14695) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/27 15:47:01 (14706) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/27 15:47:01 (14706) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/27 15:47:01 (14706) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/27 15:52:02 (14718) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/27 15:52:02 (14718) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/27 15:52:02 (14718) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/27 15:57:03 (14730) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/27 15:57:03 (14730) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/27 15:57:03 (14730) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/27 16:02:04 (14876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/27 16:02:04 (14876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/27 16:02:04 (14876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/27 16:03:36 (14907) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 16:04:54 (14928) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 16:07:05 (14973) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/27 16:07:05 (14973) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/27 16:07:05 (14973) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/27 16:12:06 (14992) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/27 16:12:06 (14992) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/27 16:12:06 (14992) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/27 16:17:07 (15006) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/27 16:17:07 (15006) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/27 16:17:07 (15006) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/27 16:22:08 (15021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/27 16:22:08 (15021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/27 16:22:08 (15021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/27 16:27:09 (15033) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/27 16:27:09 (15033) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/27 16:27:09 (15033) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/27 16:32:10 (15109) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/27 16:32:10 (15109) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/27 16:32:10 (15109) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/27 16:34:10 (15142) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 16:35:01 (15163) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 16:37:11 (15210) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/27 16:37:11 (15210) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/27 16:37:11 (15210) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/27 16:42:12 (15225) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/27 16:42:12 (15225) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/27 16:42:12 (15225) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/27 16:47:13 (15234) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/27 16:47:13 (15234) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/27 16:47:13 (15234) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/27 16:52:14 (15249) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/27 16:52:14 (15249) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/27 16:52:14 (15249) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/27 16:57:15 (15258) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/27 16:57:15 (15258) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/27 16:57:15 (15258) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/27 17:02:16 (15399) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/27 17:02:16 (15399) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/27 17:02:16 (15399) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/27 17:03:05 (15407) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 17:03:33 (15449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 17:07:17 (15500) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/27 17:07:17 (15500) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/27 17:07:17 (15500) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/27 17:12:18 (15515) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/27 17:12:18 (15515) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/27 17:12:18 (15515) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/27 17:17:19 (15528) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/27 17:17:19 (15528) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/27 17:17:19 (15528) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/27 17:22:20 (15543) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/27 17:22:20 (15543) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/27 17:22:20 (15543) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/27 17:27:21 (15555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/27 17:27:21 (15555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/27 17:27:21 (15555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/27 17:31:40 (15606) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 17:32:23 (15645) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/27 17:32:23 (15645) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/27 17:32:23 (15645) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/27 17:35:20 (15673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 17:37:24 (15725) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/27 17:37:24 (15725) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/27 17:37:24 (15725) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/27 17:42:25 (15738) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/27 17:42:25 (15738) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/27 17:42:25 (15738) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/27 17:47:26 (15753) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/27 17:47:26 (15753) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/27 17:47:26 (15753) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/27 17:52:27 (15766) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/27 17:52:27 (15766) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/27 17:52:27 (15766) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/27 17:57:28 (15777) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/27 17:57:28 (15777) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/27 17:57:28 (15777) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/27 17:58:03 (15782) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 18:02:29 (15913) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/27 18:02:29 (15913) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/27 18:02:29 (15913) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/27 18:03:40 (15965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 18:07:30 (16016) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/27 18:07:30 (16016) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/27 18:07:30 (16016) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/27 18:12:31 (16028) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/27 18:12:31 (16028) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/27 18:12:31 (16028) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/27 18:17:32 (16045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/27 18:17:32 (16045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/27 18:17:32 (16045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/27 18:22:33 (16058) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/27 18:22:33 (16058) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/27 18:22:33 (16058) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/27 18:27:32 (16076) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 18:27:34 (16092) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/27 18:27:34 (16092) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/27 18:27:34 (16092) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/27 18:32:35 (16105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/27 18:32:35 (16105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/27 18:32:35 (16105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/27 18:35:19 (16197) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 18:37:36 (16239) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/27 18:37:36 (16239) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/27 18:37:36 (16239) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/27 18:42:37 (16258) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/27 18:42:37 (16258) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/27 18:42:37 (16258) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/27 18:47:38 (16270) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/27 18:47:38 (16270) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/27 18:47:38 (16270) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/27 18:52:39 (16283) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/27 18:52:39 (16283) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/27 18:52:39 (16283) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/27 18:57:40 (16295) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/27 18:57:40 (16295) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/27 18:57:40 (16295) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/27 19:00:31 (16356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 19:02:41 (16393) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/27 19:02:41 (16393) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/27 19:02:41 (16393) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/27 19:04:58 (16456) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 19:07:42 (16520) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/27 19:07:42 (16520) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/27 19:07:42 (16520) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/27 19:12:43 (16538) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/27 19:12:43 (16538) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/27 19:12:43 (16538) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/27 19:17:44 (16553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/27 19:17:44 (16553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/27 19:17:44 (16553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/27 19:22:46 (16566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/27 19:22:46 (16566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/27 19:22:46 (16566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/27 19:27:47 (16581) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/27 19:27:47 (16581) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/27 19:27:47 (16581) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/27 19:29:24 (16591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 19:32:48 (16617) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/27 19:32:48 (16617) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/27 19:32:48 (16617) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/27 19:37:48 (16743) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 19:37:49 (16759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/27 19:37:49 (16759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/27 19:37:49 (16759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/27 19:42:50 (16775) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/27 19:42:50 (16775) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/27 19:42:50 (16775) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/27 19:47:51 (16785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/27 19:47:51 (16785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/27 19:47:51 (16785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/27 19:52:52 (16801) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/27 19:52:52 (16801) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/27 19:52:52 (16801) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/27 19:57:53 (16813) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/27 19:57:53 (16813) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/27 19:57:53 (16813) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/27 20:00:30 (16877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 20:02:54 (16912) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/27 20:02:54 (16912) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/27 20:02:54 (16912) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/27 20:07:55 (17010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/27 20:07:55 (17010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/27 20:07:55 (17010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/27 20:10:05 (17046) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 20:12:56 (17066) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/27 20:12:56 (17066) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/27 20:12:56 (17066) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/27 20:17:57 (17077) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/27 20:17:57 (17077) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/27 20:17:57 (17077) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/27 20:22:58 (17092) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/27 20:22:58 (17092) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/27 20:22:58 (17092) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/27 20:27:59 (17109) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/27 20:27:59 (17109) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/27 20:27:59 (17109) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/27 20:28:19 (17110) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 20:33:00 (17137) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/27 20:33:00 (17137) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/27 20:33:00 (17137) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/27 20:38:01 (17202) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/27 20:38:01 (17202) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/27 20:38:01 (17202) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/27 20:39:45 (17266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 20:43:02 (17291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/27 20:43:02 (17291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/27 20:43:02 (17291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/27 20:48:03 (17303) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/27 20:48:03 (17303) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/27 20:48:03 (17303) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/27 20:53:04 (17316) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/27 20:53:04 (17316) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/27 20:53:04 (17316) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/27 20:58:05 (17332) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/27 20:58:05 (17332) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/27 20:58:05 (17332) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/27 20:58:25 (17334) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 21:03:06 (17433) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/27 21:03:06 (17433) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/27 21:03:06 (17433) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/27 21:07:51 (17495) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 21:08:07 (17511) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/27 21:08:07 (17511) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/27 21:08:07 (17511) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/27 21:13:08 (17587) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/27 21:13:08 (17587) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/27 21:13:08 (17587) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/27 21:18:09 (17602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/27 21:18:09 (17602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/27 21:18:09 (17602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/27 21:23:11 (17617) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/27 21:23:11 (17617) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/27 21:23:11 (17617) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/27 21:27:27 (17634) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 21:28:11 (17650) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/27 21:28:11 (17650) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/27 21:28:11 (17650) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/27 21:33:12 (17665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/27 21:33:12 (17665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/27 21:33:12 (17665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/27 21:38:13 (17730) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/27 21:38:13 (17730) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/27 21:38:13 (17730) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/27 21:38:26 (17731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 21:43:14 (17822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/27 21:43:14 (17822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/27 21:43:14 (17822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/27 21:48:15 (17835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/27 21:48:15 (17835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/27 21:48:15 (17835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/27 21:53:16 (17847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/27 21:53:16 (17847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/27 21:53:16 (17847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/27 21:58:17 (17858) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/27 21:58:17 (17858) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/27 21:58:17 (17858) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/27 21:59:19 (17864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 22:03:18 (17958) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/27 22:03:18 (17958) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/27 22:03:18 (17958) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/27 22:08:19 (18018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/27 22:08:19 (18018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/27 22:08:19 (18018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/27 22:10:29 (18030) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 22:13:20 (18112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/27 22:13:20 (18112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/27 22:13:20 (18112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/27 22:18:21 (18127) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/27 22:18:21 (18127) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/27 22:18:21 (18127) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/27 22:23:22 (18141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/27 22:23:22 (18141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/27 22:23:22 (18141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/27 22:28:23 (18152) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/27 22:28:23 (18152) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/27 22:28:23 (18152) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/27 22:29:36 (18159) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 22:33:24 (18185) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/27 22:33:24 (18185) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/27 22:33:24 (18185) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/27 22:38:25 (18246) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/27 22:38:25 (18246) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/27 22:38:25 (18246) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/27 22:42:55 (18270) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 22:43:26 (18322) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/27 22:43:26 (18322) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/27 22:43:26 (18322) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/27 22:48:27 (18356) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/27 22:48:27 (18356) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/27 22:48:27 (18356) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/27 22:53:28 (18417) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/27 22:53:28 (18417) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/27 22:53:28 (18417) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/27 22:58:29 (18428) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/27 22:58:29 (18428) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/27 22:58:29 (18428) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/27 23:01:26 (18509) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 23:03:30 (18527) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/27 23:03:30 (18527) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/27 23:03:30 (18527) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/27 23:08:31 (18592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/27 23:08:31 (18592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/27 23:08:31 (18592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/27 23:13:32 (18678) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/27 23:13:32 (18678) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/27 23:13:32 (18678) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/27 23:14:05 (18680) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 23:18:33 (18767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/27 23:18:33 (18767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/27 23:18:33 (18767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/27 23:23:34 (18781) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/27 23:23:34 (18781) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/27 23:23:34 (18781) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/27 23:28:35 (18797) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/27 23:28:35 (18797) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/27 23:28:35 (18797) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/27 23:28:55 (18798) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 23:33:36 (18827) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/27 23:33:36 (18827) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/27 23:33:36 (18827) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/27 23:38:37 (18888) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/27 23:38:37 (18888) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/27 23:38:37 (18888) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/27 23:41:22 (18904) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/27 23:43:38 (18926) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/27 23:43:38 (18926) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/27 23:43:38 (18926) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/27 23:48:39 (18998) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/27 23:48:39 (18998) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/27 23:48:39 (18998) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/27 23:53:40 (19021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/27 23:53:40 (19021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/27 23:53:40 (19021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/27 23:58:41 (19032) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/27 23:58:41 (19032) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/27 23:58:41 (19032) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/27 23:59:56 (19038) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 00:03:42 (19137) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/28 00:03:42 (19137) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/28 00:03:42 (19137) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/28 00:08:43 (19195) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/28 00:08:43 (19195) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/28 00:08:43 (19195) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/28 00:10:03 (19205) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 00:13:44 (19229) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/28 00:13:44 (19229) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/28 00:13:44 (19229) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/28 00:18:45 (19300) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/28 00:18:45 (19300) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/28 00:18:45 (19300) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/28 00:23:46 (19318) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/28 00:23:46 (19318) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/28 00:23:46 (19318) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/28 00:28:33 (19329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 00:28:47 (19346) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/28 00:28:47 (19346) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/28 00:28:47 (19346) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/28 00:33:48 (19363) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/28 00:33:48 (19363) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/28 00:33:48 (19363) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/28 00:38:49 (19421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/28 00:38:49 (19421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/28 00:38:49 (19421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/28 00:40:52 (19435) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 00:43:50 (19463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/28 00:43:50 (19463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/28 00:43:50 (19463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/28 00:48:51 (19532) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/28 00:48:51 (19532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/28 00:48:51 (19532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/28 00:53:52 (19547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/28 00:53:52 (19547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/28 00:53:52 (19547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/28 00:56:16 (19557) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 00:58:53 (19576) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/28 00:58:53 (19576) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/28 00:58:53 (19576) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/28 01:03:54 (19664) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/28 01:03:54 (19664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/28 01:03:54 (19664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/28 01:05:24 (19729) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/28 01:05:24 (19729) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/28 01:05:24 (19729) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/28 01:06:04 (19820) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 01:07:02 (19847) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 01:10:25 (19901) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/28 01:10:25 (19901) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/28 01:10:25 (19901) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/28 01:15:26 (19913) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/28 01:15:26 (19913) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/28 01:15:26 (19913) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/28 01:20:27 (19991) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/28 01:20:27 (19991) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/28 01:20:27 (19991) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/28 01:25:28 (20001) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/28 01:25:28 (20001) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/28 01:25:28 (20001) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/28 01:30:29 (20014) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/28 01:30:29 (20014) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/28 01:30:29 (20014) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/28 01:35:28 (20032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 01:35:30 (20048) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/28 01:35:30 (20048) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/28 01:35:30 (20048) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/28 01:38:54 (20107) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 01:40:31 (20132) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/28 01:40:31 (20132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/28 01:40:31 (20132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/28 01:45:32 (20147) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/28 01:45:32 (20147) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/28 01:45:32 (20147) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/28 01:50:33 (20195) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/28 01:50:33 (20195) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/28 01:50:33 (20195) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/28 01:55:35 (20228) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/28 01:55:35 (20228) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/28 01:55:35 (20228) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/28 02:00:36 (20296) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/28 02:00:36 (20296) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/28 02:00:36 (20296) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/28 02:05:37 (20332) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/28 02:05:37 (20332) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/28 02:05:37 (20332) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/28 02:05:55 (20336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 02:07:59 (20387) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 02:10:38 (20431) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/28 02:10:38 (20431) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/28 02:10:38 (20431) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/28 02:15:39 (20451) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/28 02:15:39 (20451) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/28 02:15:39 (20451) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/28 02:20:40 (20469) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/28 02:20:40 (20469) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/28 02:20:40 (20469) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/28 02:25:41 (20542) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/28 02:25:41 (20542) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/28 02:25:41 (20542) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/28 02:30:42 (20614) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/28 02:30:42 (20614) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/28 02:30:42 (20614) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/28 02:34:26 (20624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 02:35:22 (20649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 02:35:43 (20669) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/28 02:35:43 (20669) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/28 02:35:43 (20669) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/28 02:40:44 (20725) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/28 02:40:44 (20725) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/28 02:40:44 (20725) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/28 02:45:45 (20743) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/28 02:45:45 (20743) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/28 02:45:45 (20743) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/28 02:50:46 (20753) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/28 02:50:46 (20753) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/28 02:50:46 (20753) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/28 02:55:47 (20827) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/28 02:55:47 (20827) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/28 02:55:47 (20827) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/28 03:00:48 (20886) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/28 03:00:48 (20886) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/28 03:00:48 (20886) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/28 03:04:48 (20923) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 03:05:49 (20942) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/28 03:05:49 (20942) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/28 03:05:49 (20942) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/28 03:08:10 (20973) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 03:10:50 (21023) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/28 03:10:50 (21023) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/28 03:10:50 (21023) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/28 03:15:51 (21043) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/28 03:15:51 (21043) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/28 03:15:51 (21043) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/28 03:20:52 (21056) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/28 03:20:52 (21056) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/28 03:20:52 (21056) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/28 03:25:53 (21130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/28 03:25:53 (21130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/28 03:25:53 (21130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/28 03:30:54 (21140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/28 03:30:54 (21140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/28 03:30:54 (21140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/28 03:35:52 (21172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 03:35:55 (21188) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/28 03:35:55 (21188) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/28 03:35:55 (21188) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/28 03:40:38 (21246) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 03:40:56 (21263) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/28 03:40:56 (21263) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/28 03:40:56 (21263) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/28 03:45:57 (21280) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/28 03:45:57 (21280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/28 03:45:57 (21280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/28 03:50:58 (21290) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/28 03:50:58 (21290) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/28 03:50:58 (21290) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/28 03:55:59 (21364) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/28 03:55:59 (21364) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/28 03:55:59 (21364) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/28 04:01:00 (21423) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/28 04:01:00 (21423) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/28 04:01:00 (21423) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/28 04:03:58 (21456) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 04:06:02 (21480) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/28 04:06:02 (21480) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/28 04:06:02 (21480) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/28 04:11:03 (21536) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/28 04:11:03 (21536) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/28 04:11:03 (21536) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/28 04:12:25 (21544) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 04:16:04 (21861) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/28 04:16:04 (21861) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/28 04:16:04 (21861) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/28 04:21:05 (21876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/28 04:21:05 (21876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/28 04:21:05 (21876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/28 04:26:06 (21925) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/28 04:26:06 (21925) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/28 04:26:06 (21925) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/28 04:31:07 (21957) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/28 04:31:07 (21957) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/28 04:31:07 (21957) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/28 04:32:31 (21965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 04:36:08 (21993) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/28 04:36:08 (21993) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/28 04:36:08 (21993) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/28 04:41:09 (22056) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/28 04:41:09 (22056) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/28 04:41:09 (22056) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/28 04:41:22 (22057) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 04:46:10 (22088) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/28 04:46:10 (22088) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/28 04:46:10 (22088) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/28 04:51:11 (22101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/28 04:51:11 (22101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/28 04:51:11 (22101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/28 04:56:12 (22114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/28 04:56:12 (22114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/28 04:56:12 (22114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/28 05:01:13 (22250) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/28 05:01:13 (22250) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/28 05:01:13 (22250) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/28 05:04:48 (22262) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 05:06:14 (22282) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/28 05:06:14 (22282) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/28 05:06:14 (22282) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/28 05:11:15 (22345) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/28 05:11:15 (22345) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/28 05:11:15 (22345) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/28 05:14:05 (22355) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 05:16:16 (22373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/28 05:16:16 (22373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/28 05:16:16 (22373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/28 05:21:17 (22397) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/28 05:21:17 (22397) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/28 05:21:17 (22397) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/28 05:26:18 (22406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/28 05:26:18 (22406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/28 05:26:18 (22406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/28 05:31:19 (22480) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/28 05:31:19 (22480) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/28 05:31:19 (22480) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/28 05:33:29 (22492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 05:36:20 (22511) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/28 05:36:20 (22511) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/28 05:36:20 (22511) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/28 05:41:21 (22581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 05:41:21 (22597) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/28 05:41:21 (22597) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/28 05:41:21 (22597) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/28 05:46:22 (22609) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/28 05:46:22 (22609) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/28 05:46:22 (22609) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/28 05:51:23 (22621) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/28 05:51:23 (22621) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/28 05:51:23 (22621) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/28 05:56:25 (22630) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/28 05:56:25 (22630) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/28 05:56:25 (22630) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/28 06:01:25 (22777) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/28 06:01:25 (22777) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/28 06:01:25 (22777) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/28 06:01:37 (22778) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 06:06:26 (22806) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/28 06:06:26 (22806) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/28 06:06:26 (22806) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/28 06:11:27 (22866) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/28 06:11:27 (22866) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/28 06:11:27 (22866) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/28 06:12:51 (22875) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 06:16:28 (22898) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/28 06:16:28 (22898) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/28 06:16:28 (22898) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/28 06:21:29 (22916) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/28 06:21:29 (22916) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/28 06:21:29 (22916) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/28 06:26:30 (22928) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/28 06:26:30 (22928) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/28 06:26:30 (22928) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/28 06:29:51 (22945) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 06:31:31 (23024) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/28 06:31:31 (23024) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/28 06:31:31 (23024) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/28 06:36:32 (23033) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/28 06:36:32 (23033) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/28 06:36:32 (23033) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/28 06:41:33 (23098) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/28 06:41:33 (23098) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/28 06:41:33 (23098) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/28 06:42:32 (23105) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 06:46:34 (23125) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/28 06:46:34 (23125) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/28 06:46:34 (23125) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/28 06:51:35 (23142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/28 06:51:35 (23142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/28 06:51:35 (23142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/28 06:56:36 (23196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/28 06:56:36 (23196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/28 06:56:36 (23196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/28 07:01:37 (23321) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/28 07:01:37 (23321) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/28 07:01:37 (23321) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/28 07:02:28 (23327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 07:06:38 (23372) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/28 07:06:38 (23372) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/28 07:06:38 (23372) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/28 07:11:39 (23585) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/28 07:11:39 (23585) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/28 07:11:39 (23585) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/28 07:11:49 (23599) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 07:16:40 (23625) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/28 07:16:40 (23625) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/28 07:16:40 (23625) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/28 07:21:41 (23643) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/28 07:21:41 (23643) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/28 07:21:41 (23643) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/28 07:26:42 (23652) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/28 07:26:42 (23652) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/28 07:26:42 (23652) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/28 07:29:16 (19727) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x5371ed8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x5371ed8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x534e668)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x52...', 'HASH(0x532df48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x52e12a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x52daaa8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x52daaa8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x52bed20)', 'handle_results', 'CODE(0x49e5cc0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x52b3cc0)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/04/28 07:31:43 (23738) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/28 07:31:43 (23738) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/28 07:31:43 (23738) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/28 07:36:44 (23808) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/28 07:36:44 (23808) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/28 07:36:44 (23808) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/28 07:41:45 (23873) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/28 07:41:45 (23873) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/28 07:41:45 (23873) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/28 07:44:18 (23882) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 07:46:47 (23900) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/28 07:46:47 (23900) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/28 07:46:47 (23900) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/28 07:51:47 (23981) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/28 07:51:47 (23981) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/28 07:51:47 (23981) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/28 07:56:48 (23987) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/28 07:56:48 (23987) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/28 07:56:48 (23987) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/28 07:58:04 (19727) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x52edcc0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x52edcc0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x5381ea0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x52...', 'HASH(0x5307148)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x52e12a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x52daaa8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52cf4a0)', 'HASH(0x52daaa8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x52bed20)', 'handle_results', 'CODE(0x49e5cc0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x52b3cc0)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/04/28 08:01:49 (24113) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/28 08:01:49 (24113) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/28 08:01:49 (24113) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/28 08:02:10 (24157) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/28 08:02:10 (24157) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/28 08:02:10 (24157) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/28 08:03:15 (24263) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/28 08:03:15 (24263) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/28 08:03:15 (24263) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/28 08:03:42 (24331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:04:09 (24427) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:04:10 (24433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:04:15 (24442) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:04:16 (24449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:04:39 (24451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:05:55 (24548) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:08:16 (24583) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/28 08:08:16 (24583) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/28 08:08:16 (24583) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/28 08:13:15 (24626) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:13:17 (24632) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/28 08:13:17 (24632) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/28 08:13:17 (24632) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/28 08:14:30 (24670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:15:01 (24706) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:15:11 (24712) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:15:14 (24718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:18:18 (24727) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/28 08:18:18 (24727) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/28 08:18:18 (24727) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/28 08:23:19 (24750) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/28 08:23:19 (24750) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/28 08:23:19 (24750) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/28 08:23:41 (24769) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:24:43 (24779) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:25:06 (24809) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:25:07 (24818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:26:14 (24845) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:28:20 (24849) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/28 08:28:20 (24849) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/28 08:28:20 (24849) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/28 08:31:46 (24894) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:32:53 (24915) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:33:21 (24922) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/28 08:33:21 (24922) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/28 08:33:21 (24922) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/28 08:34:30 (24945) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:35:28 (25011) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:35:40 (25023) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:35:53 (25049) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:36:08 (25088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:38:22 (25121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/28 08:38:22 (25121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/28 08:38:22 (25121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/28 08:42:39 (25163) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:43:23 (25170) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/28 08:43:23 (25170) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/28 08:43:23 (25170) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/28 08:44:00 (25174) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:44:52 (25184) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:46:20 (25227) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:46:56 (25256) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:48:24 (25266) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/28 08:48:24 (25266) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/28 08:48:24 (25266) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/28 08:53:26 (25335) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/28 08:53:26 (25335) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/28 08:53:26 (25335) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/28 08:53:29 (25344) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:54:16 (25362) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:54:40 (25412) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/28 08:54:40 (25412) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/28 08:54:40 (25412) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/28 08:55:12 (25496) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:55:31 (25545) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:55:31 (25546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:55:39 (25574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:55:56 (25578) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:56:48 (25585) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 08:59:41 (25615) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/28 08:59:41 (25615) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/28 08:59:41 (25615) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/28 09:04:22 (25699) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:04:42 (25706) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/28 09:04:42 (25706) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/28 09:04:42 (25706) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/28 09:05:00 (25730) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:05:11 (25752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:06:18 (25819) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:06:25 (25825) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:09:43 (25885) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/28 09:09:43 (25885) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/28 09:09:43 (25885) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/28 09:14:44 (25942) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/28 09:14:44 (25942) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/28 09:14:44 (25942) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/28 09:14:49 (25958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:15:02 (25963) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:15:38 (25973) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:16:09 (26002) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:17:05 (26018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:19:45 (26031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/28 09:19:45 (26031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/28 09:19:45 (26031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/28 09:23:54 (26067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:24:47 (26086) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/28 09:24:47 (26086) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/28 09:24:47 (26086) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/28 09:25:19 (26098) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:25:55 (26113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:26:13 (26140) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:26:19 (26149) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:27:57 (26173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:28:14 (26180) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:29:48 (26202) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/28 09:29:48 (26202) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/28 09:29:48 (26202) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/28 09:34:22 (26316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:34:49 (26318) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/28 09:34:49 (26318) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/28 09:34:49 (26318) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/28 09:36:01 (26335) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:36:06 (26342) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:37:12 (26375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:37:18 (26384) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:39:50 (26476) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/28 09:39:50 (26476) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/28 09:39:50 (26476) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/28 09:44:17 (26545) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:44:51 (26547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/28 09:44:51 (26547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/28 09:44:51 (26547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/28 09:46:05 (26653) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:47:04 (26724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:48:10 (26753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:48:13 (26762) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:49:52 (26774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/28 09:49:52 (26774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/28 09:49:52 (26774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/28 09:54:02 (26806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:54:53 (26824) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/28 09:54:53 (26824) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/28 09:54:53 (26824) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/28 09:55:51 (26835) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:56:55 (26879) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:57:13 (26886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:57:38 (26898) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:58:29 (26908) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 09:59:54 (26920) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/28 09:59:54 (26920) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/28 09:59:54 (26920) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/28 10:00:38 (26979) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:04:10 (27058) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:04:55 (27060) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/28 10:04:55 (27060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/28 10:04:55 (27060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/28 10:06:45 (27087) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:07:45 (27108) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:07:47 (27114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:08:12 (27124) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:09:56 (27218) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/28 10:09:56 (27218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/28 10:09:56 (27218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/28 10:13:38 (27265) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:14:57 (27283) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/28 10:14:57 (27283) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/28 10:14:57 (27283) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/28 10:16:46 (27313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:17:35 (27329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:17:54 (27338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:18:07 (27348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:19:58 (27360) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/28 10:19:58 (27360) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/28 10:19:58 (27360) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/28 10:23:48 (27392) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:24:59 (27418) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/28 10:24:59 (27418) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/28 10:24:59 (27418) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/28 10:25:03 (27419) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:26:09 (27459) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:27:03 (27478) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:27:28 (27490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:28:09 (27500) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:30:00 (27509) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/28 10:30:00 (27509) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/28 10:30:00 (27509) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/28 10:32:09 (27524) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:33:27 (27579) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:35:02 (27583) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/28 10:35:02 (27583) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/28 10:35:02 (27583) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/28 10:36:33 (27607) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:37:29 (27623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:37:46 (27635) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:38:46 (27650) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:40:03 (27715) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/28 10:40:03 (27715) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/28 10:40:03 (27715) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/28 10:42:57 (27784) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:45:04 (27805) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/28 10:45:04 (27805) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/28 10:45:04 (27805) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/28 10:45:57 (27827) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:48:21 (27853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:48:26 (27859) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:48:59 (27868) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:50:05 (27879) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/28 10:50:05 (27879) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/28 10:50:05 (27879) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/28 10:53:31 (27922) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:55:06 (27925) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/28 10:55:06 (27925) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/28 10:55:06 (27925) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/28 10:56:41 (27955) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:56:46 (27972) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:58:58 (27997) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:59:22 (28018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 10:59:56 (28027) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:00:07 (28090) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/28 11:00:07 (28090) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/28 11:00:07 (28090) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/28 11:00:28 (28092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:03:51 (28166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:05:08 (28169) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/28 11:05:08 (28169) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/28 11:05:08 (28169) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/28 11:06:54 (28201) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:08:34 (28221) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:09:45 (28255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:10:00 (28266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:10:09 (28276) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/28 11:10:09 (28276) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/28 11:10:09 (28276) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/28 11:13:57 (28397) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:15:10 (28404) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/28 11:15:10 (28404) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/28 11:15:10 (28404) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/28 11:16:25 (28427) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:19:22 (28453) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:19:55 (28462) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:20:08 (28475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:20:11 (28482) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/28 11:20:11 (28482) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/28 11:20:11 (28482) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/28 11:23:38 (28528) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:25:12 (28532) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/28 11:25:12 (28532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/28 11:25:12 (28532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/28 11:25:56 (28556) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:29:03 (28579) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:29:21 (28586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:29:54 (28605) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:30:13 (28616) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/28 11:30:13 (28616) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/28 11:30:13 (28616) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/28 11:30:31 (28623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:32:43 (28655) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:32:54 (28671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:35:14 (28695) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/28 11:35:14 (28695) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/28 11:35:14 (28695) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/28 11:35:45 (28716) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:39:38 (28770) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:39:42 (28776) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:39:47 (28782) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:40:15 (28796) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/28 11:40:15 (28796) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/28 11:40:15 (28796) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/28 11:42:07 (28867) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:45:13 (28943) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:45:16 (28952) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/28 11:45:16 (28952) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/28 11:45:16 (28952) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/28 11:50:04 (29005) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:50:17 (29015) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/28 11:50:17 (29015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/28 11:50:17 (29015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/28 11:50:21 (29019) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:50:27 (29028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:52:28 (29059) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:55:16 (29100) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 11:55:19 (29109) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/28 11:55:19 (29109) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/28 11:55:19 (29109) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/28 11:57:40 (29118) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:00:20 (29193) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/28 12:00:20 (29193) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/28 12:00:20 (29193) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/28 12:00:54 (29200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:01:08 (29231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:01:21 (29243) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:02:55 (29285) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:03:42 (29292) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:04:46 (29329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:05:21 (29343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/28 12:05:21 (29343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/28 12:05:21 (29343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/28 12:09:55 (29382) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:10:20 (29396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:10:22 (29405) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/28 12:10:22 (29405) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/28 12:10:22 (29405) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/28 12:11:42 (29416) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:12:25 (29478) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:13:50 (29534) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:15:23 (29569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/28 12:15:23 (29569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/28 12:15:23 (29569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/28 12:20:16 (29592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:20:22 (29598) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:20:24 (29604) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/28 12:20:24 (29604) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/28 12:20:24 (29604) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/28 12:21:44 (29631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:22:42 (29637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:24:16 (29685) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:25:25 (29698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/28 12:25:25 (29698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/28 12:25:25 (29698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/28 12:27:32 (29706) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:29:31 (29731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:30:26 (29745) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/28 12:30:26 (29745) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/28 12:30:26 (29745) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/28 12:30:56 (29772) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:31:00 (29778) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:31:55 (29791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:32:11 (29797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:34:08 (29852) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:35:27 (29866) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/28 12:35:27 (29866) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/28 12:35:27 (29866) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/28 12:39:29 (29904) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:40:28 (29917) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/28 12:40:28 (29917) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/28 12:40:28 (29917) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/28 12:40:44 (29921) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:41:26 (29951) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:41:50 (29962) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:45:03 (30061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:45:29 (30093) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/28 12:45:29 (30093) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/28 12:45:29 (30093) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/28 12:49:26 (30105) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:50:30 (30119) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/28 12:50:30 (30119) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/28 12:50:30 (30119) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/28 12:51:30 (30127) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:52:02 (30153) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:52:17 (30159) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:55:31 (30205) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/28 12:55:31 (30205) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/28 12:55:31 (30205) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/28 12:55:38 (30206) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:59:14 (30223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 12:59:30 (30243) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:00:32 (30314) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/28 13:00:33 (30314) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/28 13:00:33 (30314) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/28 13:01:44 (30342) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:01:48 (30348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:02:18 (30375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:03:54 (30382) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:05:33 (30437) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/28 13:05:33 (30437) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/28 13:05:33 (30437) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/28 13:05:42 (30438) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:09:47 (30510) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:10:35 (30524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/28 13:10:35 (30524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/28 13:10:35 (30524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/28 13:11:18 (30534) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:12:08 (30549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:12:40 (30594) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:14:43 (30639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:15:35 (30649) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/28 13:15:35 (30649) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/28 13:15:35 (30649) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/28 13:20:12 (30802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:20:36 (30812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/28 13:20:36 (30812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/28 13:20:36 (30812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/28 13:20:54 (30816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:21:56 (30850) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:22:44 (30856) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:25:00 (30910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:25:37 (30920) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/28 13:25:37 (30920) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/28 13:25:37 (30920) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/28 13:29:06 (31046) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/28 13:29:06 (31046) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/28 13:29:06 (31046) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/28 13:29:19 (31114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:29:49 (31211) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/28 13:29:49 (31211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/28 13:29:49 (31211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/28 13:30:30 (31343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/28 13:30:30 (31343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/28 13:30:30 (31343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/28 13:31:12 (31389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:32:02 (31437) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/28 13:32:02 (31437) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/28 13:32:02 (31437) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/28 13:32:29 (31507) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:32:51 (31554) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/28 13:32:51 (31554) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/28 13:32:51 (31554) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/28 13:33:19 (31598) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:34:36 (31612) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:35:12 (31658) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/28 13:35:12 (31658) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/28 13:35:12 (31658) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/28 13:35:32 (31716) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:37:25 (31730) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:38:55 (31758) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:40:12 (31806) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/28 13:40:12 (31806) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/28 13:40:12 (31806) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/28 13:45:01 (31916) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:45:13 (31922) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/28 13:45:13 (31922) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/28 13:45:13 (31922) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/28 13:50:14 (32002) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/28 13:50:14 (32002) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/28 13:50:14 (32002) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/28 13:54:11 (32019) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 13:55:15 (32026) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/28 13:55:15 (32026) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/28 13:55:15 (32026) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/28 14:00:16 (32097) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/28 14:00:16 (32097) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/28 14:00:16 (32097) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/28 14:05:01 (32129) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:05:17 (32135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/28 14:05:17 (32135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/28 14:05:17 (32135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/28 14:08:25 (32150) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:09:58 (32198) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:10:18 (32218) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/28 14:10:18 (32218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/28 14:10:18 (32218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/28 14:13:59 (32249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:15:19 (32258) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/28 14:15:19 (32258) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/28 14:15:19 (32258) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/28 14:20:20 (32355) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/28 14:20:20 (32355) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/28 14:20:20 (32355) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/28 14:23:09 (32366) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:25:21 (32421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/28 14:25:21 (32421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/28 14:25:21 (32421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/28 14:30:22 (32444) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/28 14:30:22 (32444) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/28 14:30:22 (32444) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/28 14:32:44 (32452) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:35:23 (32463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/28 14:35:23 (32463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/28 14:35:23 (32463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/28 14:37:07 (32469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:38:10 (32490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:40:24 (32546) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/28 14:40:24 (32546) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/28 14:40:24 (32546) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/28 14:41:50 (32551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:45:25 (32588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/28 14:45:25 (32588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/28 14:45:25 (32588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/28 14:50:26 (32669) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/28 14:50:26 (32669) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/28 14:50:26 (32669) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/28 14:52:01 (32678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 14:55:27 (32746) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/28 14:55:27 (32746) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/28 14:55:27 (32746) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/28 15:00:28 (353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/28 15:00:28 (353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/28 15:00:28 (353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/28 15:02:23 (376) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:05:29 (390) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/28 15:05:29 (390) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/28 15:05:29 (390) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/28 15:09:29 (407) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:10:04 (432) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:10:30 (474) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/28 15:10:30 (474) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/28 15:10:30 (474) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/28 15:12:37 (541) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:15:31 (582) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/28 15:15:31 (582) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/28 15:15:31 (582) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/28 15:20:32 (646) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/28 15:20:32 (646) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/28 15:20:32 (646) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/28 15:22:26 (683) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:25:33 (701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/28 15:25:33 (701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/28 15:25:33 (701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/28 15:30:34 (721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/28 15:30:34 (721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/28 15:30:34 (721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/28 15:31:36 (726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:35:35 (743) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/28 15:35:35 (743) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/28 15:35:35 (743) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/28 15:37:21 (754) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:39:31 (777) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:40:36 (824) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/28 15:40:36 (824) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/28 15:40:36 (824) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/28 15:40:50 (828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:45:37 (874) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/28 15:45:37 (874) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/28 15:45:37 (874) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/28 15:50:38 (935) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/28 15:50:38 (935) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/28 15:50:38 (935) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/28 15:50:41 (936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 15:55:39 (1013) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/28 15:55:39 (1013) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/28 15:55:39 (1013) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/28 16:00:40 (1086) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/28 16:00:40 (1086) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/28 16:00:40 (1086) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/28 16:01:40 (1108) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:05:41 (1132) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/28 16:05:41 (1132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/28 16:05:41 (1132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/28 16:08:46 (1145) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:09:52 (1171) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:10:42 (1218) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/28 16:10:42 (1218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/28 16:10:42 (1218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/28 16:12:17 (1223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:15:43 (1276) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/28 16:15:43 (1276) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/28 16:15:43 (1276) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/28 16:20:44 (1298) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/28 16:20:44 (1298) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/28 16:20:44 (1298) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/28 16:21:21 (1302) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:25:45 (1399) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/28 16:25:45 (1399) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/28 16:25:45 (1399) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/28 16:30:46 (1418) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/28 16:30:46 (1418) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/28 16:30:46 (1418) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/28 16:31:01 (1422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:35:47 (1449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/28 16:35:47 (1449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/28 16:35:47 (1449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/28 16:38:50 (1457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:39:58 (1487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:40:04 (1511) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:40:48 (1548) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/28 16:40:48 (1548) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/28 16:40:48 (1548) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/28 16:45:49 (1587) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/28 16:45:49 (1587) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/28 16:45:49 (1587) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/28 16:50:14 (1602) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 16:50:50 (1609) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/28 16:50:50 (1609) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/28 16:50:50 (1609) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/28 16:55:51 (1700) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/28 16:55:51 (1700) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/28 16:55:51 (1700) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/28 17:00:16 (1770) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:00:52 (1777) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/28 17:00:52 (1777) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/28 17:00:52 (1777) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/28 17:05:54 (1814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/28 17:05:54 (1814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/28 17:05:54 (1814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/28 17:08:25 (1821) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:09:54 (1853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:10:54 (1913) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/28 17:10:54 (1913) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/28 17:10:54 (1913) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/28 17:11:03 (1914) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:15:55 (1961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/28 17:15:55 (1961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/28 17:15:55 (1961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/28 17:20:45 (1978) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:20:56 (1984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/28 17:20:56 (1984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/28 17:20:56 (1984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/28 17:25:57 (2052) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/28 17:25:57 (2052) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/28 17:25:57 (2052) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/28 17:30:44 (2101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:30:58 (2110) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/28 17:30:58 (2110) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/28 17:30:58 (2110) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/28 17:35:59 (2133) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/28 17:35:59 (2133) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/28 17:35:59 (2133) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/28 17:36:19 (2139) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:40:13 (2173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:40:19 (2179) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:41:00 (2196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/28 17:41:00 (2196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/28 17:41:00 (2196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/28 17:46:01 (2274) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/28 17:46:01 (2274) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/28 17:46:01 (2274) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/28 17:50:34 (2290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 17:51:02 (2298) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/28 17:51:02 (2298) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/28 17:51:02 (2298) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/28 17:56:03 (2333) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/28 17:56:03 (2333) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/28 17:56:03 (2333) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/28 18:00:40 (2458) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:01:04 (2481) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/28 18:01:04 (2481) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/28 18:01:04 (2481) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/28 18:06:05 (2501) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/28 18:06:05 (2501) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/28 18:06:05 (2501) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/28 18:07:02 (2507) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:10:31 (2537) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:10:39 (2544) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:11:06 (2560) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/28 18:11:06 (2560) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/28 18:11:06 (2560) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/28 18:16:07 (2624) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/28 18:16:07 (2624) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/28 18:16:07 (2624) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/28 18:20:05 (2642) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:21:08 (2653) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/28 18:21:08 (2653) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/28 18:21:08 (2653) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/28 18:26:09 (2679) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/28 18:26:09 (2679) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/28 18:26:09 (2679) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/28 18:30:38 (2758) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:31:10 (2764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:31:10 (2764) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 18:31:10 (2764) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 18:31:10 (2764) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 18:36:11 (2783) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/28 18:36:11 (2783) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/28 18:36:11 (2783) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/28 18:37:10 (2791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:38:00 (2812) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:39:44 (2833) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:41:12 (2846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:41:12 (2846) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 18:41:12 (2846) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 18:41:12 (2846) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 18:46:13 (2911) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/28 18:46:13 (2911) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/28 18:46:13 (2911) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/28 18:49:15 (2920) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:51:14 (2938) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 18:51:15 (2938) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 18:51:15 (2938) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 18:51:15 (2938) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 18:56:15 (2965) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/28 18:56:15 (2965) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/28 18:56:15 (2965) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/28 18:59:29 (3036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:01:17 (3114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/28 19:01:17 (3114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/28 19:01:17 (3114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/28 19:06:17 (3135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/28 19:06:17 (3135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/28 19:06:17 (3135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/28 19:07:46 (3142) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:09:29 (3163) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:10:18 (3187) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:11:18 (3196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/28 19:11:18 (3196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/28 19:11:18 (3196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/28 19:16:19 (3260) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/28 19:16:19 (3260) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/28 19:16:19 (3260) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/28 19:19:51 (3275) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:21:20 (3290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:21:20 (3290) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 19:21:20 (3290) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 19:21:20 (3290) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 19:26:21 (3315) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/28 19:26:21 (3315) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/28 19:26:21 (3315) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/28 19:30:15 (3375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:31:22 (3406) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:31:22 (3406) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 19:31:22 (3406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 19:31:22 (3406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 19:36:23 (3428) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/28 19:36:23 (3428) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/28 19:36:23 (3428) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/28 19:38:24 (3435) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:39:53 (3457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:40:18 (3480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:41:24 (3490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:41:24 (3490) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 19:41:24 (3490) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 19:41:24 (3490) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 19:46:25 (3556) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/28 19:46:25 (3556) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/28 19:46:25 (3556) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/28 19:50:52 (3577) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:51:26 (3583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 19:51:26 (3583) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 19:51:26 (3583) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 19:51:26 (3583) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 19:56:27 (3605) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/28 19:56:27 (3605) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/28 19:56:27 (3605) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/28 19:59:56 (3616) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:01:28 (3733) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/28 20:01:28 (3733) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/28 20:01:28 (3733) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/28 20:06:29 (3772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/28 20:06:29 (3772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/28 20:06:29 (3772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/28 20:09:06 (3783) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:09:30 (3789) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:11:30 (3811) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/28 20:11:30 (3811) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/28 20:11:30 (3811) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/28 20:12:20 (3844) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:16:31 (3898) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/28 20:16:31 (3898) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/28 20:16:31 (3898) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/28 20:18:55 (3917) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:21:32 (3932) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/28 20:21:32 (3932) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/28 20:21:32 (3932) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/28 20:26:33 (3955) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/28 20:26:33 (3955) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/28 20:26:33 (3955) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/28 20:28:58 (3964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:31:34 (3984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/28 20:31:34 (3984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/28 20:31:34 (3984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/28 20:36:35 (4058) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/28 20:36:35 (4058) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/28 20:36:35 (4058) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/28 20:38:46 (4065) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:39:47 (4076) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:41:36 (4102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:41:37 (4102) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 20:41:37 (4102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 20:41:37 (4102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 20:44:05 (4140) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:46:38 (4186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/28 20:46:38 (4186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/28 20:46:38 (4186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/28 20:48:28 (4194) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:51:38 (4211) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 20:51:38 (4211) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 20:51:38 (4211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 20:51:38 (4211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 20:56:39 (4235) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/28 20:56:39 (4235) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/28 20:56:39 (4235) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/28 20:58:42 (4248) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:01:40 (4330) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/28 21:01:40 (4330) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/28 21:01:40 (4330) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/28 21:06:41 (4408) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/28 21:06:41 (4408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/28 21:06:41 (4408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/28 21:08:17 (4414) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:11:36 (4439) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:11:42 (4455) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/28 21:11:42 (4455) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/28 21:11:42 (4455) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/28 21:16:43 (4526) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/28 21:16:43 (4526) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/28 21:16:43 (4526) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/28 21:16:45 (4527) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:17:35 (4546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:21:44 (4575) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/28 21:21:44 (4575) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/28 21:21:44 (4575) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/28 21:26:45 (4595) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:26:45 (4595) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 21:26:45 (4595) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 21:26:45 (4595) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 21:27:06 (4601) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:31:46 (4627) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/28 21:31:46 (4627) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/28 21:31:46 (4627) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/28 21:36:47 (4702) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:36:47 (4702) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 21:36:47 (4702) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 21:36:47 (4702) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 21:38:00 (4709) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:40:46 (4731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:41:48 (4751) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/28 21:41:48 (4751) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/28 21:41:48 (4751) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/28 21:46:49 (4815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:46:49 (4815) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 21:46:49 (4815) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 21:46:49 (4815) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 21:47:26 (4821) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:49:03 (4835) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 21:51:50 (4864) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/28 21:51:50 (4864) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/28 21:51:50 (4864) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/28 21:56:51 (4886) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/28 21:56:51 (4886) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/28 21:56:51 (4886) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/28 21:57:46 (4891) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:01:52 (4978) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/28 22:01:52 (4978) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/28 22:01:52 (4978) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/28 22:06:53 (5052) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:06:53 (5052) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 22:06:53 (5052) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 22:06:53 (5052) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 22:08:30 (5062) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:10:09 (5081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:11:54 (5101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/28 22:11:54 (5101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/28 22:11:54 (5101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/28 22:16:55 (5165) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:16:55 (5165) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 22:16:55 (5165) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 22:16:55 (5165) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 22:18:46 (5178) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:20:34 (5198) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:21:56 (5218) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/28 22:21:56 (5218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/28 22:21:56 (5218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/28 22:26:57 (5242) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:26:58 (5242) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 22:26:58 (5242) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 22:26:58 (5242) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 22:28:31 (5251) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:31:59 (5270) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/28 22:31:59 (5270) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/28 22:31:59 (5270) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/28 22:36:59 (5321) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/28 22:36:59 (5321) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/28 22:36:59 (5321) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/28 22:38:33 (5352) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:38:39 (5358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:42:00 (5388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/28 22:42:00 (5388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/28 22:42:00 (5388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/28 22:47:01 (5449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:47:01 (5449) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 22:47:01 (5449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 22:47:01 (5449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 22:48:25 (5456) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:52:02 (5480) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/28 22:52:02 (5480) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/28 22:52:02 (5480) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/28 22:52:54 (5486) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:57:03 (5573) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 22:57:03 (5573) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 22:57:03 (5573) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 22:57:03 (5573) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 22:58:45 (5580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:02:04 (5666) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/28 23:02:04 (5666) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/28 23:02:04 (5666) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/28 23:07:05 (5683) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:07:05 (5683) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 23:07:05 (5683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 23:07:05 (5683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 23:09:33 (5753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:10:42 (5768) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:12:06 (5788) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/28 23:12:06 (5788) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/28 23:12:06 (5788) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/28 23:17:07 (5904) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:17:07 (5904) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 23:17:07 (5904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 23:17:07 (5904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 23:19:27 (5914) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:20:03 (5931) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:22:08 (5954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/28 23:22:08 (5954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/28 23:22:08 (5954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/28 23:27:09 (5978) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:27:09 (5978) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/28 23:27:09 (5978) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/28 23:27:09 (5978) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/28 23:29:45 (5994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:32:10 (6012) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/28 23:32:10 (6012) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/28 23:32:10 (6012) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/28 23:37:11 (6025) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/28 23:37:11 (6025) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/28 23:37:11 (6025) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/28 23:37:53 (6031) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:39:16 (6089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:42:12 (6131) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/28 23:42:12 (6131) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/28 23:42:12 (6131) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/28 23:47:13 (6197) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/28 23:47:13 (6197) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/28 23:47:13 (6197) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/28 23:47:40 (6199) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:49:02 (6220) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/28 23:52:14 (6243) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/28 23:52:14 (6243) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/28 23:52:14 (6243) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/28 23:57:15 (6287) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/28 23:57:15 (6287) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/28 23:57:15 (6287) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/28 23:58:33 (6292) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:02:16 (6433) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/29 00:02:16 (6433) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/29 00:02:16 (6433) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/29 00:07:17 (6449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/29 00:07:17 (6449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/29 00:07:17 (6449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/04/29 00:08:32 (6454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:10:00 (6471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:12:18 (6553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/29 00:12:18 (6553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/29 00:12:18 (6553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/04/29 00:15:05 (6593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:17:19 (6640) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/29 00:17:19 (6640) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/29 00:17:19 (6640) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/04/29 00:19:33 (6652) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:22:21 (6674) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/29 00:22:21 (6674) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/29 00:22:21 (6674) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/04/29 00:27:21 (6694) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/29 00:27:21 (6694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/29 00:27:21 (6694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/04/29 00:28:35 (6699) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:32:22 (6723) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/29 00:32:22 (6723) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/29 00:32:22 (6723) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/04/29 00:37:23 (6737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/29 00:37:23 (6737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/29 00:37:23 (6737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/04/29 00:38:16 (6742) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:40:37 (6764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:42:24 (6842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/29 00:42:24 (6842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/29 00:42:24 (6842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/04/29 00:43:52 (6867) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:47:25 (6921) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/29 00:47:25 (6921) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/29 00:47:25 (6921) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/04/29 00:48:12 (6926) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 00:52:26 (6945) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/29 00:52:26 (6945) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/29 00:52:26 (6945) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/04/29 00:57:27 (6968) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/29 00:57:27 (6968) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/29 00:57:27 (6968) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/04/29 00:57:31 (6969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:02:28 (7067) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/29 01:02:28 (7067) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/29 01:02:28 (7067) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/04/29 01:05:23 (7137) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/29 01:05:23 (7137) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/29 01:05:23 (7137) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/04/29 01:05:45 (7199) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:07:06 (7236) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:08:24 (7261) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:10:24 (7286) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/29 01:10:24 (7286) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/29 01:10:24 (7286) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/04/29 01:15:25 (7382) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/29 01:15:25 (7382) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/29 01:15:25 (7382) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/04/29 01:16:25 (7417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:20:27 (7438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/29 01:20:27 (7438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/29 01:20:27 (7438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/04/29 01:25:28 (7447) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/29 01:25:28 (7447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/29 01:25:28 (7447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/04/29 01:25:42 (7451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:30:29 (7477) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/29 01:30:29 (7477) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/29 01:30:29 (7477) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/04/29 01:35:10 (7501) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:35:30 (7508) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/29 01:35:30 (7508) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/29 01:35:30 (7508) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/04/29 01:35:38 (7511) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:38:16 (7553) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:40:31 (7575) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/29 01:40:31 (7575) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/29 01:40:31 (7575) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/04/29 01:44:34 (7645) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:45:32 (7683) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/29 01:45:32 (7683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/29 01:45:32 (7683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/04/29 01:50:33 (7718) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/29 01:50:33 (7718) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/29 01:50:33 (7718) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/04/29 01:53:37 (7725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 01:55:34 (7738) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/29 01:55:34 (7738) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/29 01:55:34 (7738) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/04/29 02:00:15 (7835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/29 02:00:15 (7835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/29 02:00:15 (7835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/04/29 02:00:57 (7910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:01:00 (7927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:01:23 (7955) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:05:16 (7979) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/29 02:05:16 (7979) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/29 02:05:16 (7979) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/04/29 02:10:17 (8013) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/29 02:10:17 (8013) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/29 02:10:17 (8013) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/04/29 02:10:37 (8017) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:15:18 (8133) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/29 02:15:18 (8133) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/29 02:15:18 (8133) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/04/29 02:20:19 (8196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/29 02:20:19 (8196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/29 02:20:19 (8196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/04/29 02:21:27 (8201) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:25:20 (8211) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/29 02:25:20 (8211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/29 02:25:20 (8211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/04/29 02:30:21 (8300) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/29 02:30:21 (8300) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/29 02:30:21 (8300) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/04/29 02:31:27 (8310) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:31:38 (8316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:32:28 (8337) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:35:22 (8359) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/29 02:35:22 (8359) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/29 02:35:22 (8359) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/04/29 02:40:23 (8393) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/29 02:40:23 (8393) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/29 02:40:23 (8393) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/04/29 02:40:32 (8395) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:45:24 (8434) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/29 02:45:24 (8434) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/29 02:45:24 (8434) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/04/29 02:49:38 (8530) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:50:25 (8541) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/29 02:50:25 (8541) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/29 02:50:25 (8541) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/04/29 02:55:26 (8552) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/29 02:55:26 (8552) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/29 02:55:26 (8552) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/04/29 02:58:47 (8568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:59:58 (8592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 02:59:59 (8608) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:00:27 (8668) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/29 03:00:27 (8668) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/29 03:00:27 (8668) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/04/29 03:05:28 (8704) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/29 03:05:28 (8704) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/29 03:05:28 (8704) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/04/29 03:10:29 (8732) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/29 03:10:29 (8732) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/29 03:10:29 (8732) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/04/29 03:10:49 (8736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:15:30 (8776) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/29 03:15:30 (8776) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/29 03:15:30 (8776) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/04/29 03:20:01 (8896) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:20:31 (8903) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/29 03:20:31 (8903) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/29 03:20:31 (8903) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/04/29 03:25:32 (18985) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/29 03:25:32 (18985) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/29 03:25:32 (18985) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/04/29 03:28:11 (19007) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:28:37 (19024) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:29:42 (19044) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:30:33 (19055) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/29 03:30:33 (19055) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/29 03:30:33 (19055) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/04/29 03:35:34 (19069) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/29 03:35:34 (19069) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/29 03:35:34 (19069) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/04/29 03:40:35 (19102) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/29 03:40:35 (19102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/29 03:40:35 (19102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/04/29 03:40:37 (19103) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:45:36 (19141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/29 03:45:36 (19141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/29 03:45:36 (19141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/04/29 03:50:37 (19239) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/29 03:50:37 (19239) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/29 03:50:37 (19239) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/04/29 03:51:10 (19244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:55:28 (19260) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 03:55:38 (19276) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/29 03:55:38 (19276) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/29 03:55:38 (19276) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/04/29 03:57:55 (19294) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:00:30 (19369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:00:39 (19375) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/29 04:00:39 (19375) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/29 04:00:39 (19375) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/04/29 04:05:40 (19406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/29 04:05:40 (19406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/29 04:05:40 (19406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/04/29 04:10:41 (19440) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/29 04:10:41 (19440) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/29 04:10:41 (19440) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/04/29 04:10:47 (19441) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:15:42 (19483) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/29 04:15:42 (19483) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/29 04:15:42 (19483) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/04/29 04:20:01 (19563) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:20:43 (19596) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/29 04:20:43 (19596) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/29 04:20:43 (19596) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/04/29 04:25:44 (19606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/29 04:25:44 (19606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/29 04:25:44 (19606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/04/29 04:28:07 (19624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:28:49 (19644) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:29:38 (19664) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:30:45 (19675) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/29 04:30:45 (19675) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/29 04:30:45 (19675) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/04/29 04:35:46 (19698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/29 04:35:46 (19698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/29 04:35:46 (19698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/04/29 04:40:01 (19718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:40:47 (19732) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/29 04:40:47 (19732) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/29 04:40:47 (19732) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/04/29 04:45:48 (19762) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/29 04:45:48 (19762) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/29 04:45:48 (19762) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/04/29 04:50:29 (19810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:50:49 (19853) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/29 04:50:49 (19853) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/29 04:50:49 (19853) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/04/29 04:55:51 (19884) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/29 04:55:51 (19884) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/29 04:55:51 (19884) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/04/29 04:56:19 (19889) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 04:57:39 (19916) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:00:52 (19991) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/29 05:00:52 (19991) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/29 05:00:52 (19991) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/04/29 05:01:23 (20019) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:05:53 (20079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/29 05:05:53 (20079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/29 05:05:53 (20079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/04/29 05:10:54 (20103) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/29 05:10:54 (20103) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/29 05:10:54 (20103) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/04/29 05:10:56 (20104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:15:55 (20150) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/29 05:15:55 (20150) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/29 05:15:55 (20150) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/04/29 05:20:36 (20192) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:20:56 (20203) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/29 05:20:56 (20203) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/29 05:20:56 (20203) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/04/29 05:25:57 (20281) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/29 05:25:57 (20281) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/29 05:25:57 (20281) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/04/29 05:26:17 (20283) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:30:06 (20319) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:30:58 (20330) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/29 05:30:58 (20330) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/29 05:30:58 (20330) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/04/29 05:31:41 (20336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:35:59 (20366) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/29 05:35:59 (20366) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/29 05:35:59 (20366) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/04/29 05:40:46 (20391) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:41:00 (20397) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/29 05:41:00 (20397) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/29 05:41:00 (20397) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/04/29 05:46:01 (20435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/29 05:46:01 (20435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/29 05:46:01 (20435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/04/29 05:51:02 (20475) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/29 05:51:02 (20475) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/29 05:51:02 (20475) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/04/29 05:51:32 (20480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:56:03 (20553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/29 05:56:03 (20553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/29 05:56:03 (20553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/04/29 05:58:17 (20574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 05:58:43 (20591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:01:04 (20687) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/29 06:01:04 (20687) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/29 06:01:04 (20687) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/04/29 06:01:11 (20689) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:06:05 (20708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/29 06:06:05 (20708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/29 06:06:05 (20708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/04/29 06:11:06 (20730) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/29 06:11:06 (20730) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/29 06:11:06 (20730) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/04/29 06:12:08 (20735) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:16:07 (20780) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/29 06:16:07 (20780) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/29 06:16:07 (20780) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/04/29 06:21:08 (20820) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/29 06:21:08 (20820) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/29 06:21:08 (20820) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/04/29 06:22:29 (20826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:26:09 (20901) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/29 06:26:09 (20901) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/29 06:26:09 (20901) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/04/29 06:29:14 (20923) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:31:10 (20950) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/29 06:31:10 (20950) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/29 06:31:10 (20950) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/04/29 06:31:40 (20953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:32:54 (20975) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:36:11 (20995) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/29 06:36:11 (20995) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/29 06:36:11 (20995) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/04/29 06:41:13 (21012) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/29 06:41:13 (21012) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/29 06:41:13 (21012) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/04/29 06:43:32 (21021) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:46:14 (21063) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/29 06:46:14 (21063) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/29 06:46:14 (21063) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/04/29 06:51:15 (21103) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/29 06:51:15 (21103) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/29 06:51:15 (21103) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/04/29 06:52:42 (21108) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 06:56:16 (21206) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/29 06:56:16 (21206) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/29 06:56:16 (21206) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/04/29 06:59:21 (21238) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:01:17 (21331) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/29 07:01:17 (21331) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/29 07:01:17 (21331) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/04/29 07:02:59 (21336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:03:59 (21349) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:06:18 (21379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/29 07:06:18 (21379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/29 07:06:18 (21379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/04/29 07:11:19 (21398) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/29 07:11:19 (21398) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/29 07:11:19 (21398) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/04/29 07:12:17 (21403) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:16:20 (21506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/29 07:16:20 (21506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/29 07:16:20 (21506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/04/29 07:21:21 (21547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/29 07:21:21 (21547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/29 07:21:21 (21547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/04/29 07:22:52 (21552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:26:22 (21578) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/29 07:26:22 (21578) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/29 07:26:22 (21578) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/04/29 07:26:48 (21615) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:31:23 (21674) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/29 07:31:23 (21674) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/29 07:31:23 (21674) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/04/29 07:32:52 (21683) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:33:13 (21689) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:36:24 (21716) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/29 07:36:24 (21716) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/29 07:36:24 (21716) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/04/29 07:41:25 (21737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/29 07:41:25 (21737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/29 07:41:25 (21737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/04/29 07:43:36 (21745) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:46:26 (21781) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/29 07:46:26 (21781) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/29 07:46:26 (21781) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/04/29 07:51:27 (21823) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/29 07:51:27 (21823) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/29 07:51:27 (21823) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/04/29 07:53:50 (21830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:54:25 (21853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 07:56:28 (21868) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/29 07:56:28 (21868) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/29 07:56:28 (21868) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/04/29 08:01:29 (22019) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/29 08:01:29 (22019) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/29 08:01:29 (22019) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/04/29 08:04:44 (22030) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:06:05 (22044) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:06:30 (22061) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/29 08:06:30 (22061) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/29 08:06:30 (22061) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/04/29 08:11:31 (22081) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/29 08:11:31 (22081) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/29 08:11:31 (22081) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/04/29 08:15:22 (22093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:16:33 (22127) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/29 08:16:33 (22127) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/29 08:16:33 (22127) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/04/29 08:21:33 (22173) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/29 08:21:33 (22173) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/29 08:21:33 (22173) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/04/29 08:24:19 (22181) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:24:52 (22200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:26:34 (22215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/29 08:26:34 (22215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/29 08:26:34 (22215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/04/29 08:31:35 (22299) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/29 08:31:35 (22299) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/29 08:31:35 (22299) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/04/29 08:34:07 (22313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:34:13 (22329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:36:36 (22343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/29 08:36:36 (22343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/29 08:36:36 (22343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/04/29 08:41:37 (22363) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/29 08:41:37 (22363) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/29 08:41:37 (22363) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/04/29 08:44:51 (22372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:46:38 (22409) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/29 08:46:38 (22409) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/29 08:46:38 (22409) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/04/29 08:51:39 (22440) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/29 08:51:39 (22440) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/29 08:51:39 (22440) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/04/29 08:54:13 (22446) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 08:56:40 (22459) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/29 08:56:40 (22459) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/29 08:56:40 (22459) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/04/29 08:56:56 (22460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:01:41 (22626) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/29 09:01:41 (22626) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/29 09:01:41 (22626) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/04/29 09:03:24 (22636) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:03:52 (22643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:06:42 (22665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/29 09:06:42 (22665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/29 09:06:42 (22665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/04/29 09:11:43 (22689) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/29 09:11:43 (22689) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/29 09:11:43 (22689) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/04/29 09:13:39 (22697) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:16:44 (22736) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/29 09:16:44 (22736) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/29 09:16:44 (22736) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/04/29 09:21:45 (22779) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/29 09:21:45 (22779) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/29 09:21:45 (22779) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/04/29 09:23:47 (22790) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:24:11 (22797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:26:46 (22826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/29 09:26:46 (22826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/29 09:26:46 (22826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/04/29 09:31:47 (22889) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/29 09:31:47 (22889) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/29 09:31:47 (22889) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/04/29 09:34:33 (22922) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:36:29 (22940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:36:48 (22956) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/29 09:36:48 (22956) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/29 09:36:48 (22956) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/04/29 09:41:49 (22977) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/29 09:41:49 (22977) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/29 09:41:49 (22977) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/04/29 09:43:32 (22983) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:46:50 (23024) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/29 09:46:50 (23024) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/29 09:46:50 (23024) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/04/29 09:51:51 (23064) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/29 09:51:51 (23064) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/29 09:51:51 (23064) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/04/29 09:53:39 (23070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:56:14 (23089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 09:56:52 (23109) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/29 09:56:52 (23109) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/29 09:56:52 (23109) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/04/29 10:01:54 (23205) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/29 10:01:54 (23205) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/29 10:01:54 (23205) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/04/29 10:03:17 (23245) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:06:54 (23283) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/29 10:06:54 (23283) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/29 10:06:54 (23283) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/04/29 10:08:45 (23298) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:11:55 (23327) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/29 10:11:55 (23327) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/29 10:11:55 (23327) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/04/29 10:12:39 (23332) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:16:56 (23374) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/29 10:16:56 (23374) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/29 10:16:56 (23374) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/04/29 10:21:57 (23421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/29 10:21:57 (23421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/29 10:21:57 (23421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/04/29 10:22:38 (23426) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:26:08 (23446) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:26:58 (23463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/29 10:26:58 (23463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/29 10:26:58 (23463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/04/29 10:31:59 (23495) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/29 10:31:59 (23495) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/29 10:31:59 (23495) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/04/29 10:32:45 (23503) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:37:00 (23581) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/29 10:37:00 (23581) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/29 10:37:00 (23581) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/04/29 10:37:59 (23584) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:42:01 (23619) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/29 10:42:01 (23619) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/29 10:42:01 (23619) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/04/29 10:42:54 (23624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:47:02 (23664) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/29 10:47:02 (23664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/29 10:47:02 (23664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/04/29 10:52:03 (23706) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/29 10:52:03 (23706) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/29 10:52:03 (23706) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/04/29 10:52:59 (23711) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 10:57:04 (23737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/29 10:57:04 (23737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/29 10:57:04 (23737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/04/29 10:57:19 (23738) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:02:05 (23838) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/29 11:02:05 (23838) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/29 11:02:05 (23838) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/04/29 11:02:23 (23842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:07:06 (23929) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/29 11:07:06 (23929) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/29 11:07:06 (23929) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/04/29 11:07:19 (23930) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:12:07 (23966) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/29 11:12:07 (23966) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/29 11:12:07 (23966) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/04/29 11:13:13 (23971) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:17:08 (24018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/29 11:17:08 (24018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/29 11:17:08 (24018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/04/29 11:22:09 (24058) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/29 11:22:09 (24058) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/29 11:22:09 (24058) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/04/29 11:23:38 (24064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:27:10 (24083) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/29 11:27:10 (24083) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/29 11:27:10 (24083) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/04/29 11:27:59 (24092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:32:11 (24128) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/29 11:32:11 (24128) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/29 11:32:11 (24128) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/04/29 11:33:03 (24136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:37:09 (24219) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:37:12 (24235) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/29 11:37:12 (24235) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/29 11:37:12 (24235) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/04/29 11:42:13 (24257) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/29 11:42:13 (24257) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/29 11:42:13 (24257) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/04/29 11:42:25 (24258) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:47:14 (24302) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/29 11:47:14 (24302) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/29 11:47:14 (24302) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/04/29 11:52:02 (24347) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:52:15 (24353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/29 11:52:15 (24353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/29 11:52:15 (24353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/04/29 11:56:57 (24375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 11:57:16 (24391) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/29 11:57:16 (24391) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/29 11:57:16 (24391) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/04/29 12:02:17 (24476) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/29 12:02:17 (24476) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/29 12:02:17 (24476) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/04/29 12:02:48 (24481) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:07:18 (24544) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/29 12:07:18 (24544) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/29 12:07:18 (24544) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/04/29 12:09:47 (24580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:12:19 (24605) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/29 12:12:19 (24605) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/29 12:12:19 (24605) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/04/29 12:12:37 (24610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:17:20 (24654) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/29 12:17:20 (24654) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/29 12:17:20 (24654) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/04/29 12:21:46 (24704) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:22:21 (24710) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/29 12:22:21 (24710) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/29 12:22:21 (24710) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/04/29 12:26:54 (24727) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:27:22 (24743) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/29 12:27:22 (24743) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/29 12:27:22 (24743) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/04/29 12:32:04 (24768) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:32:23 (24776) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/29 12:32:23 (24776) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/29 12:32:23 (24776) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/04/29 12:37:24 (24794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/29 12:37:24 (24794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/29 12:37:24 (24794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/04/29 12:40:52 (24876) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:42:19 (24900) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:42:25 (24906) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/29 12:42:25 (24906) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/29 12:42:25 (24906) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/04/29 12:47:26 (24941) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/29 12:47:26 (24941) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/29 12:47:26 (24941) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/04/29 12:52:27 (24986) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/29 12:52:27 (24986) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/29 12:52:27 (24986) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/04/29 12:53:17 (24991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:55:58 (25013) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 12:57:28 (25030) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/29 12:57:28 (25030) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/29 12:57:28 (25030) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/04/29 13:02:29 (25118) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/29 13:02:29 (25118) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/29 13:02:29 (25118) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/04/29 13:03:17 (25123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:07:30 (25140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/29 13:07:30 (25140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/29 13:07:30 (25140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/04/29 13:09:34 (25189) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:12:31 (25239) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/29 13:12:31 (25239) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/29 13:12:31 (25239) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/04/29 13:14:02 (25245) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:17:32 (25286) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/29 13:17:32 (25286) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/29 13:17:32 (25286) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/04/29 13:22:33 (25332) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/29 13:22:33 (25332) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/29 13:22:33 (25332) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/04/29 13:23:02 (25337) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:24:46 (25354) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:27:34 (25378) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/29 13:27:34 (25378) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/29 13:27:34 (25378) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/04/29 13:32:14 (25401) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:32:35 (25410) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/29 13:32:35 (25410) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/29 13:32:35 (25410) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/04/29 13:37:36 (25427) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/29 13:37:36 (25427) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/29 13:37:36 (25427) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/04/29 13:37:59 (25428) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:41:51 (25524) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:42:37 (25531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/29 13:42:37 (25531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/29 13:42:37 (25531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/04/29 13:47:38 (25566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/29 13:47:38 (25566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/29 13:47:38 (25566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/04/29 13:51:44 (25610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:52:39 (25621) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/29 13:52:39 (25621) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/29 13:52:39 (25621) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/04/29 13:55:10 (25748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 13:57:40 (25808) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/29 13:57:40 (25808) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/29 13:57:40 (25808) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/04/29 14:02:21 (25897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:02:41 (25904) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/29 14:02:41 (25904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/29 14:02:41 (25904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/04/29 14:06:50 (25918) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:07:42 (25935) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/29 14:07:42 (25935) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/29 14:07:42 (25935) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/04/29 14:12:05 (25991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:12:43 (25998) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/29 14:12:43 (25998) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/29 14:12:43 (25998) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/04/29 14:17:44 (26040) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/29 14:17:44 (26040) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/29 14:17:44 (26040) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/04/29 14:22:45 (26108) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/29 14:22:45 (26108) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/29 14:22:45 (26108) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/04/29 14:22:52 (26109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:26:37 (26134) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:27:46 (26152) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/29 14:27:46 (26152) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/29 14:27:46 (26152) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/04/29 14:32:47 (26175) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/29 14:32:47 (26175) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/29 14:32:47 (26175) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/04/29 14:33:28 (26179) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:34:52 (26198) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:37:48 (26217) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/29 14:37:48 (26217) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/29 14:37:48 (26217) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/04/29 14:42:37 (26238) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:42:49 (26245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/29 14:42:49 (26245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/29 14:42:49 (26245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/04/29 14:47:50 (26316) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/29 14:47:50 (26316) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/29 14:47:50 (26316) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/04/29 14:52:51 (26381) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/29 14:52:51 (26381) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/29 14:52:51 (26381) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/04/29 14:53:03 (26385) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 14:57:52 (26456) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/29 14:57:52 (26456) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/29 14:57:52 (26456) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/04/29 14:59:12 (26462) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:02:12 (26567) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:02:26 (26586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:02:53 (26593) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/29 15:02:53 (26593) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/29 15:02:53 (26593) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/04/29 15:07:54 (26606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/29 15:07:54 (26606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/29 15:07:54 (26606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/04/29 15:12:55 (26622) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/29 15:12:55 (26622) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/29 15:12:55 (26622) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/04/29 15:13:15 (26629) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:17:56 (26766) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/29 15:17:56 (26766) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/29 15:17:56 (26766) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/04/29 15:22:15 (26821) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:22:58 (26833) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/29 15:22:58 (26833) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/29 15:22:58 (26833) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/04/29 15:26:41 (26854) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:27:59 (26871) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/29 15:27:59 (26871) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/29 15:27:59 (26871) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/04/29 15:31:20 (26891) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:31:40 (26900) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:33:00 (26924) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/29 15:33:00 (26924) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/29 15:33:00 (26924) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/04/29 15:38:01 (26936) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/29 15:38:01 (26936) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/29 15:38:01 (26936) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/04/29 15:41:15 (26950) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:43:02 (26961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/29 15:43:02 (26961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/29 15:43:02 (26961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/04/29 15:48:03 (27035) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/29 15:48:03 (27035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/29 15:48:03 (27035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/04/29 15:52:09 (27095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 15:53:04 (27102) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/29 15:53:04 (27102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/29 15:53:04 (27102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/04/29 15:58:05 (27125) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/29 15:58:05 (27125) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/29 15:58:05 (27125) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/04/29 15:59:35 (27131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:01:12 (27227) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:03:06 (27239) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/29 16:03:06 (27239) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/29 16:03:06 (27239) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/04/29 16:03:10 (27240) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:08:07 (27274) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/29 16:08:07 (27274) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/29 16:08:07 (27274) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/04/29 16:11:57 (27289) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:13:08 (27296) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/29 16:13:08 (27296) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/29 16:13:08 (27296) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/04/29 16:18:09 (27376) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/29 16:18:09 (27376) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/29 16:18:09 (27376) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/04/29 16:21:50 (27432) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:23:10 (27439) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/29 16:23:10 (27439) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/29 16:23:10 (27439) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/04/29 16:28:11 (27466) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/29 16:28:11 (27466) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/29 16:28:11 (27466) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/04/29 16:31:23 (27480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:31:45 (27500) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:33:01 (27517) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:33:12 (27533) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/29 16:33:12 (27533) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/29 16:33:12 (27533) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/04/29 16:38:13 (27549) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/29 16:38:13 (27549) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/29 16:38:13 (27549) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/04/29 16:40:49 (27560) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:43:14 (27576) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/29 16:43:14 (27576) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/29 16:43:14 (27576) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/04/29 16:48:15 (27627) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/29 16:48:15 (27627) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/29 16:48:15 (27627) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/04/29 16:50:41 (27682) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 16:53:16 (27720) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/29 16:53:16 (27720) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/29 16:53:16 (27720) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/04/29 16:58:17 (27738) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/29 16:58:17 (27738) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/29 16:58:17 (27738) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/04/29 17:01:15 (27820) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:01:40 (27839) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:02:40 (27853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:03:18 (27873) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/29 17:03:18 (27873) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/29 17:03:18 (27873) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/04/29 17:08:19 (27885) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/29 17:08:19 (27885) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/29 17:08:19 (27885) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/04/29 17:11:45 (27899) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:13:20 (27910) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/29 17:13:20 (27910) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/29 17:13:20 (27910) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/04/29 17:18:21 (27929) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/29 17:18:21 (27929) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/29 17:18:21 (27929) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/04/29 17:21:41 (28048) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:23:22 (28065) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/29 17:23:22 (28065) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/29 17:23:22 (28065) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/04/29 17:28:23 (28091) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/29 17:28:23 (28091) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/29 17:28:23 (28091) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/04/29 17:29:53 (28102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:32:39 (28132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:33:24 (28142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/29 17:33:24 (28142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/29 17:33:24 (28142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/04/29 17:35:20 (28155) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:38:25 (28174) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/29 17:38:25 (28174) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/29 17:38:25 (28174) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/04/29 17:42:50 (28193) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:43:26 (28199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/29 17:43:26 (28199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/29 17:43:26 (28199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/04/29 17:48:27 (28213) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/29 17:48:27 (28213) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/29 17:48:27 (28213) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/04/29 17:51:59 (28324) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 17:53:28 (28336) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/29 17:53:28 (28336) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/29 17:53:28 (28336) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/04/29 17:58:29 (28352) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/29 17:58:29 (28352) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/29 17:58:29 (28352) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/04/29 18:00:49 (28418) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:01:32 (28454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:03:30 (28464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/29 18:03:30 (28464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/29 18:03:30 (28464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/04/29 18:04:55 (28477) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:08:31 (28499) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/29 18:08:31 (28499) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/29 18:08:31 (28499) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/04/29 18:11:59 (28514) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:13:32 (28521) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/29 18:13:32 (28521) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/29 18:13:32 (28521) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/04/29 18:18:33 (28545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/29 18:18:33 (28545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/29 18:18:33 (28545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/04/29 18:21:42 (28623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:23:34 (28675) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/29 18:23:34 (28675) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/29 18:23:34 (28675) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/04/29 18:28:11 (28697) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:28:35 (28716) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/29 18:28:35 (28716) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/29 18:28:35 (28716) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/04/29 18:31:01 (28737) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:32:29 (28748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:33:36 (28768) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/29 18:33:36 (28768) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/29 18:33:36 (28768) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/04/29 18:38:37 (28780) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/29 18:38:37 (28780) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/29 18:38:37 (28780) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/04/29 18:40:29 (28793) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:43:38 (28810) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/29 18:43:39 (28810) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/29 18:43:39 (28810) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/04/29 18:48:39 (28819) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/29 18:48:39 (28819) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/29 18:48:39 (28819) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/04/29 18:51:14 (28857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:53:40 (28948) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/29 18:53:40 (28948) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/29 18:53:40 (28948) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/04/29 18:58:19 (28968) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 18:58:41 (28987) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/29 18:58:41 (28987) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/29 18:58:41 (28987) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/04/29 19:01:20 (29075) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:01:39 (29081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:03:42 (29103) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/29 19:03:42 (29103) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/29 19:03:42 (29103) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/04/29 19:08:43 (29118) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/29 19:08:43 (29118) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/29 19:08:43 (29118) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/04/29 19:10:23 (29128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:13:44 (29139) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/29 19:13:44 (29139) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/29 19:13:44 (29139) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/04/29 19:18:45 (29160) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/29 19:18:45 (29160) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/29 19:18:45 (29160) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/04/29 19:21:01 (29195) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:23:46 (29263) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/29 19:23:46 (29263) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/29 19:23:46 (29263) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/04/29 19:26:58 (29311) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:28:47 (29335) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/29 19:28:47 (29335) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/29 19:28:47 (29335) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/04/29 19:31:20 (29352) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:31:42 (29358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:33:48 (29381) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/29 19:33:48 (29381) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/29 19:33:48 (29381) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/04/29 19:38:49 (29396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/29 19:38:49 (29396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/29 19:38:49 (29396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/04/29 19:41:05 (29407) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:43:50 (29420) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/29 19:43:50 (29420) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/29 19:43:50 (29420) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/04/29 19:48:51 (29435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/29 19:48:51 (29435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/29 19:48:51 (29435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/04/29 19:50:32 (29469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:53:52 (29504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/29 19:53:52 (29504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/29 19:53:52 (29504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/04/29 19:56:20 (29577) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 19:58:53 (29606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/29 19:58:53 (29606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/29 19:58:53 (29606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/04/29 20:00:58 (29670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:01:13 (29693) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:03:54 (29714) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/29 20:03:54 (29714) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/29 20:03:54 (29714) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/04/29 20:08:55 (29734) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/29 20:08:55 (29734) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/29 20:08:55 (29734) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/04/29 20:10:10 (29744) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:13:56 (29759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/29 20:13:56 (29759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/29 20:13:56 (29759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/04/29 20:18:57 (29776) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/29 20:18:57 (29776) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/29 20:18:57 (29776) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/04/29 20:19:49 (29804) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:23:58 (29848) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/29 20:23:58 (29848) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/29 20:23:58 (29848) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/04/29 20:28:45 (29935) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:28:59 (29952) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/29 20:28:59 (29952) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/29 20:28:59 (29952) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/04/29 20:29:38 (29956) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:33:35 (29981) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:34:01 (29998) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/29 20:34:01 (29998) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/29 20:34:01 (29998) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/04/29 20:39:01 (30017) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/29 20:39:01 (30017) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/29 20:39:01 (30017) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/04/29 20:39:14 (30021) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:44:02 (30041) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/29 20:44:02 (30041) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/29 20:44:02 (30041) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/04/29 20:49:03 (30056) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/29 20:49:03 (30056) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/29 20:49:03 (30056) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/04/29 20:49:23 (30060) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:54:04 (30123) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/29 20:54:04 (30123) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/29 20:54:04 (30123) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/04/29 20:58:34 (30204) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 20:59:05 (30213) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/29 20:59:05 (30213) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/29 20:59:05 (30213) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/04/29 21:00:50 (30278) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:02:41 (30320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:04:06 (30341) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/29 21:04:06 (30341) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/29 21:04:06 (30341) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/04/29 21:09:07 (30357) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/29 21:09:07 (30357) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/29 21:09:07 (30357) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/04/29 21:09:28 (30361) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:14:08 (30384) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/29 21:14:08 (30384) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/29 21:14:08 (30384) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/04/29 21:18:27 (30401) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:19:09 (30408) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/29 21:19:09 (30408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/29 21:19:09 (30408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/04/29 21:24:10 (30471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/29 21:24:10 (30471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/29 21:24:10 (30471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/04/29 21:28:52 (30531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:29:11 (30560) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/29 21:29:11 (30560) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/29 21:29:11 (30560) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/04/29 21:29:42 (30565) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:34:12 (30602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/29 21:34:12 (30602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/29 21:34:12 (30602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/04/29 21:35:11 (30608) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:38:49 (30640) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:39:13 (30647) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/29 21:39:13 (30647) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/29 21:39:13 (30647) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/04/29 21:44:14 (30660) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/29 21:44:14 (30660) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/29 21:44:14 (30660) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/04/29 21:48:35 (30680) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:49:15 (30687) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/29 21:49:15 (30687) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/29 21:49:15 (30687) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/04/29 21:54:16 (30745) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/29 21:54:16 (30745) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/29 21:54:16 (30745) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/04/29 21:57:36 (30764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 21:59:17 (30788) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/29 21:59:17 (30788) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/29 21:59:17 (30788) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/04/29 21:59:21 (30824) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:04:18 (30938) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/29 22:04:18 (30938) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/29 22:04:18 (30938) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/04/29 22:05:23 (30949) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:09:19 (30975) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/29 22:09:19 (30975) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/29 22:09:19 (30975) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/04/29 22:10:15 (30984) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:14:20 (30997) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/29 22:14:20 (30997) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/29 22:14:20 (30997) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/04/29 22:19:22 (31020) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/29 22:19:22 (31020) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/29 22:19:22 (31020) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/04/29 22:19:23 (31021) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:24:22 (31088) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/29 22:24:22 (31088) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/29 22:24:22 (31088) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/04/29 22:28:00 (31109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:29:23 (31127) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/29 22:29:23 (31127) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/29 22:29:23 (31127) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/04/29 22:29:59 (31134) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:33:34 (31218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:34:24 (31238) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/29 22:34:24 (31238) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/29 22:34:24 (31238) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/04/29 22:39:15 (31259) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:39:25 (31265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/29 22:39:25 (31265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/29 22:39:25 (31265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/04/29 22:44:26 (31280) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/29 22:44:26 (31280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/29 22:44:26 (31280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/04/29 22:49:27 (31298) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/29 22:49:27 (31298) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/29 22:49:27 (31298) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/04/29 22:49:29 (31299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:54:28 (31362) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/29 22:54:28 (31362) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/29 22:54:28 (31362) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/04/29 22:59:10 (31434) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 22:59:29 (31440) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/29 22:59:29 (31440) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/29 22:59:29 (31440) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/04/29 23:00:05 (31501) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:02:15 (31579) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:04:30 (31623) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/29 23:04:30 (31623) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/29 23:04:30 (31623) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/04/29 23:09:23 (31645) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:09:31 (31651) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/29 23:09:31 (31651) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/29 23:09:31 (31651) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/04/29 23:14:32 (31666) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/29 23:14:32 (31666) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/29 23:14:32 (31666) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/04/29 23:18:41 (31754) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:19:33 (31761) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/29 23:19:33 (31761) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/29 23:19:33 (31761) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/04/29 23:24:34 (31819) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/29 23:24:34 (31819) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/29 23:24:34 (31819) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/04/29 23:28:11 (31848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:28:17 (31865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:29:35 (31875) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/29 23:29:35 (31875) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/29 23:29:35 (31875) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/04/29 23:33:49 (31930) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:34:36 (31975) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/29 23:34:36 (31975) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/29 23:34:36 (31975) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/04/29 23:37:48 (31993) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:39:37 (32004) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/29 23:39:37 (32004) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/29 23:39:37 (32004) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/04/29 23:44:38 (32019) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/29 23:44:38 (32019) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/29 23:44:38 (32019) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/04/29 23:47:13 (32032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:49:39 (32043) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/29 23:49:39 (32043) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/29 23:49:39 (32043) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/04/29 23:54:40 (32111) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/29 23:54:40 (32111) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/29 23:54:40 (32111) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/04/29 23:56:19 (32125) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:58:37 (32139) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/29 23:59:41 (32159) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/29 23:59:41 (32159) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/29 23:59:41 (32159) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/04/30 00:04:42 (32295) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/30 00:04:42 (32295) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/30 00:04:42 (32295) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/04/30 00:05:43 (32333) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:06:02 (32352) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:09:44 (32365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/30 00:09:44 (32365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/30 00:09:44 (32365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/04/30 00:14:44 (32381) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/30 00:14:44 (32381) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/30 00:14:44 (32381) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/04/30 00:15:23 (32386) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:19:45 (32407) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/30 00:19:45 (32407) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/30 00:19:45 (32407) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/04/30 00:24:46 (32468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/30 00:24:46 (32468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/30 00:24:46 (32468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/04/30 00:24:53 (32469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:28:37 (32493) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:29:47 (32515) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/30 00:29:47 (32515) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/30 00:29:47 (32515) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/04/30 00:34:32 (32541) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:34:48 (32550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/30 00:34:48 (32550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/30 00:34:48 (32550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/04/30 00:38:10 (32624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:39:49 (32644) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/30 00:39:49 (32644) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/30 00:39:49 (32644) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/04/30 00:44:50 (32657) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/30 00:44:50 (32657) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/30 00:44:50 (32657) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/04/30 00:45:00 (32661) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:49:51 (32683) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/30 00:49:51 (32683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/30 00:49:51 (32683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/04/30 00:54:52 (32738) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/30 00:54:52 (32738) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/30 00:54:52 (32738) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/04/30 00:55:35 (32746) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 00:59:53 (301) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/30 00:59:53 (301) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/30 00:59:53 (301) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/04/30 01:01:00 (364) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:04:44 (412) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:04:54 (419) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/30 01:04:54 (419) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/30 01:04:54 (419) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/04/30 01:05:25 (490) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/30 01:05:25 (490) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/30 01:05:25 (490) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/04/30 01:05:39 (562) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:06:14 (574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:08:29 (668) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:10:26 (690) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/30 01:10:26 (690) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/30 01:10:26 (690) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/04/30 01:15:27 (702) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/30 01:15:27 (702) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/30 01:15:27 (702) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/04/30 01:16:14 (710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:20:28 (730) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/30 01:20:28 (730) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/30 01:20:28 (730) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/04/30 01:25:29 (787) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/30 01:25:29 (787) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/30 01:25:29 (787) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/04/30 01:26:55 (795) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:30:30 (812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/30 01:30:30 (812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/30 01:30:30 (812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/04/30 01:35:31 (835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/30 01:35:31 (835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/30 01:35:31 (835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/04/30 01:35:40 (840) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:36:05 (858) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:37:12 (888) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:40:32 (968) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/30 01:40:32 (968) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/30 01:40:32 (968) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/04/30 01:45:33 (977) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/30 01:45:33 (977) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/30 01:45:33 (977) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/04/30 01:46:31 (988) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 01:50:34 (1005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/30 01:50:34 (1005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/30 01:50:34 (1005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/04/30 01:55:35 (1060) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/30 01:55:35 (1060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/30 01:55:35 (1060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/04/30 01:55:53 (1064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:00:36 (1151) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/30 02:00:36 (1151) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/30 02:00:36 (1151) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/04/30 02:05:37 (1201) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/30 02:05:37 (1201) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/30 02:05:37 (1201) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/04/30 02:06:04 (1207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:08:16 (1230) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:08:52 (1292) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:10:38 (1336) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/30 02:10:38 (1336) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/30 02:10:38 (1336) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/04/30 02:15:39 (1358) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/30 02:15:39 (1358) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/30 02:15:39 (1358) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/04/30 02:16:53 (1369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:20:40 (1386) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/30 02:20:40 (1386) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/30 02:20:40 (1386) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/04/30 02:25:41 (1444) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/30 02:25:41 (1444) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/30 02:25:41 (1444) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/04/30 02:27:18 (1455) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:30:42 (1550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/30 02:30:42 (1550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/30 02:30:42 (1550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/04/30 02:35:43 (1569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/30 02:35:43 (1569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/30 02:35:43 (1569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/04/30 02:36:06 (1574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:37:55 (1600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:40:44 (1659) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/30 02:40:44 (1659) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/30 02:40:44 (1659) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/04/30 02:41:05 (1684) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:45:45 (1712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/30 02:45:45 (1712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/30 02:45:45 (1712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/04/30 02:47:59 (1728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 02:50:46 (1741) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/30 02:50:46 (1741) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/30 02:50:46 (1741) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/04/30 02:55:47 (1795) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/30 02:55:47 (1795) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/30 02:55:47 (1795) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/04/30 02:57:43 (1806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:00:49 (1887) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/30 03:00:49 (1887) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/30 03:00:49 (1887) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/04/30 03:03:17 (1927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:05:50 (1956) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/30 03:05:50 (1956) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/30 03:05:50 (1956) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/04/30 03:06:55 (1965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:08:03 (1979) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:10:51 (2009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/30 03:10:51 (2009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/30 03:10:51 (2009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/04/30 03:15:52 (2079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/30 03:15:52 (2079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/30 03:15:52 (2079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/04/30 03:16:31 (2090) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:20:53 (2120) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/30 03:20:53 (2120) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/30 03:20:53 (2120) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/04/30 03:25:54 (2181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/30 03:25:54 (2181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/30 03:25:54 (2181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/04/30 03:27:09 (2190) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:30:55 (2212) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/30 03:30:55 (2212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/30 03:30:55 (2212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/04/30 03:32:36 (2239) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:35:56 (2271) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/30 03:35:56 (2271) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/30 03:35:56 (2271) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/04/30 03:36:12 (2275) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:37:10 (2288) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:40:57 (2325) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/30 03:40:57 (2325) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/30 03:40:57 (2325) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/04/30 03:45:58 (2751) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/30 03:45:58 (2751) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/30 03:45:58 (2751) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/04/30 03:47:12 (2759) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:50:59 (2781) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/30 03:50:59 (2781) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/30 03:50:59 (2781) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/04/30 03:56:00 (2839) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/30 03:56:00 (2839) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/30 03:56:00 (2839) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/04/30 03:57:04 (2844) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 03:59:46 (2865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:01:01 (2946) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/30 04:01:01 (2946) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/30 04:01:01 (2946) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/04/30 04:06:02 (2964) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/30 04:06:02 (2964) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/30 04:06:02 (2964) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/04/30 04:07:17 (2981) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:07:25 (3001) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:11:03 (3018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/30 04:11:03 (3018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/30 04:11:03 (3018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/04/30 04:16:04 (3093) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/30 04:16:04 (3093) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/30 04:16:04 (3093) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/04/30 04:17:03 (3101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:21:05 (3121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/30 04:21:05 (3121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/30 04:21:05 (3121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/04/30 04:26:06 (3179) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/30 04:26:06 (3179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/30 04:26:06 (3179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/04/30 04:26:40 (3184) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:31:07 (3212) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/30 04:31:07 (3212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/30 04:31:07 (3212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/04/30 04:31:30 (3214) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:36:08 (3240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/30 04:36:08 (3240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/30 04:36:08 (3240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/04/30 04:36:42 (3255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:37:03 (3263) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:41:09 (3293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/30 04:41:09 (3293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/30 04:41:09 (3293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/04/30 04:46:11 (3362) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/30 04:46:11 (3362) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/30 04:46:11 (3362) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/04/30 04:46:59 (3369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 04:51:11 (3390) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/30 04:51:11 (3390) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/30 04:51:11 (3390) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/04/30 04:56:12 (3447) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/30 04:56:12 (3447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/30 04:56:12 (3447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/04/30 04:57:45 (3458) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:01:13 (3577) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/30 05:01:13 (3577) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/30 05:01:13 (3577) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/04/30 05:03:24 (3586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:06:14 (3608) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/30 05:06:14 (3608) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/30 05:06:14 (3608) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/04/30 05:07:25 (3619) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:08:33 (3646) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:11:15 (3658) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/30 05:11:15 (3658) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/30 05:11:15 (3658) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/04/30 05:16:16 (3707) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/30 05:16:16 (3707) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/30 05:16:16 (3707) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/04/30 05:19:04 (3744) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:21:17 (3756) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/30 05:21:17 (3756) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/30 05:21:17 (3756) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/04/30 05:26:18 (3814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/30 05:26:18 (3814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/30 05:26:18 (3814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/04/30 05:29:24 (3826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:31:19 (3838) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/30 05:31:19 (3838) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/30 05:31:19 (3838) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/04/30 05:34:02 (3848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:36:20 (3868) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/30 05:36:20 (3868) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/30 05:36:20 (3868) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/04/30 05:39:14 (3889) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:39:16 (3895) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:41:21 (3917) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/30 05:41:21 (3917) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/30 05:41:21 (3917) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/04/30 05:46:22 (3931) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/30 05:46:22 (3931) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/30 05:46:22 (3931) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/04/30 05:48:58 (4001) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 05:51:23 (4013) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/30 05:51:23 (4013) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/30 05:51:23 (4013) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/04/30 05:56:24 (4069) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/30 05:56:24 (4069) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/30 05:56:24 (4069) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/04/30 05:58:22 (4082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:01:25 (4163) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/30 06:01:25 (4163) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/30 06:01:25 (4163) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/04/30 06:04:52 (4172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:06:26 (4196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/30 06:06:26 (4196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/30 06:06:26 (4196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/04/30 06:06:54 (4199) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:07:59 (4223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:11:27 (4241) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/30 06:11:27 (4241) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/30 06:11:27 (4241) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/04/30 06:16:28 (4256) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/30 06:16:28 (4256) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/30 06:16:28 (4256) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/04/30 06:18:17 (4305) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:21:29 (4344) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/30 06:21:29 (4344) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/30 06:21:29 (4344) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/04/30 06:26:30 (4402) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/30 06:26:30 (4402) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/30 06:26:30 (4402) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/04/30 06:27:28 (4408) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:31:31 (4429) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/30 06:31:31 (4429) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/30 06:31:31 (4429) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/04/30 06:33:12 (4437) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:34:43 (4459) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:36:32 (4483) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/30 06:36:32 (4483) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/30 06:36:32 (4483) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/04/30 06:37:21 (4487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:41:34 (4511) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/30 06:41:34 (4511) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/30 06:41:34 (4511) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/04/30 06:46:34 (4521) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/30 06:46:34 (4521) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/30 06:46:34 (4521) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/04/30 06:47:07 (4525) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:51:35 (4606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/30 06:51:35 (4606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/30 06:51:35 (4606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/04/30 06:56:04 (4704) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 06:56:36 (4715) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/30 06:56:36 (4715) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/30 06:56:36 (4715) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/04/30 07:01:37 (4800) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/30 07:01:37 (4800) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/30 07:01:37 (4800) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/04/30 07:01:47 (4801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:03:43 (4825) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:06:13 (4850) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:06:38 (4857) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/30 07:06:38 (4857) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/30 07:06:38 (4857) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/04/30 07:11:39 (4872) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/30 07:11:39 (4872) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/30 07:11:39 (4872) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/04/30 07:16:29 (4886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:16:40 (4896) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/30 07:16:40 (4896) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/30 07:16:40 (4896) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/04/30 07:21:41 (5027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/30 07:21:41 (5027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/30 07:21:41 (5027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/04/30 07:25:44 (5070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:26:42 (5095) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/30 07:26:42 (5095) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/30 07:26:42 (5095) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/04/30 07:31:40 (5116) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:31:43 (5132) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/30 07:31:43 (5132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/30 07:31:43 (5132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/04/30 07:34:05 (5139) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:36:16 (5163) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:36:44 (5173) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/30 07:36:44 (5173) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/30 07:36:44 (5173) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/04/30 07:41:45 (5190) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/30 07:41:45 (5190) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/30 07:41:45 (5190) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/04/30 07:45:56 (5203) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:46:46 (5214) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/30 07:46:46 (5214) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/30 07:46:46 (5214) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/04/30 07:51:47 (5265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/30 07:51:47 (5265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/30 07:51:47 (5265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/04/30 07:55:48 (5317) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 07:56:48 (5348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/30 07:56:48 (5348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/30 07:56:48 (5348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/04/30 08:01:04 (5430) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:01:49 (5447) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/30 08:01:49 (5447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/30 08:01:49 (5447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/04/30 08:02:27 (5454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:05:29 (5479) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:06:50 (5490) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/30 08:06:50 (5490) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/30 08:06:50 (5490) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/04/30 08:11:51 (5509) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/30 08:11:51 (5509) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/30 08:11:51 (5509) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/04/30 08:15:02 (5516) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:16:53 (5529) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/30 08:16:53 (5529) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/30 08:16:53 (5529) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/04/30 08:21:53 (5550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/30 08:21:53 (5550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/30 08:21:53 (5550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/04/30 08:24:52 (5637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:26:54 (5672) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/30 08:26:54 (5672) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/30 08:26:54 (5672) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/04/30 08:31:55 (5688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/30 08:31:55 (5688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/30 08:31:55 (5688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/04/30 08:32:42 (5696) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:33:40 (5717) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:35:10 (5739) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:36:56 (5750) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/30 08:36:56 (5750) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/30 08:36:56 (5750) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/04/30 08:41:57 (5767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/30 08:41:57 (5767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/30 08:41:57 (5767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/04/30 08:46:05 (5780) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:46:58 (5787) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/30 08:46:58 (5787) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/30 08:46:58 (5787) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/04/30 08:51:59 (5803) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/30 08:51:59 (5803) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/30 08:51:59 (5803) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/04/30 08:55:58 (5895) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 08:57:00 (5924) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/30 08:57:00 (5924) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/30 08:57:00 (5924) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/04/30 09:01:46 (6010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:02:01 (6026) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/30 09:02:01 (6026) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/30 09:02:01 (6026) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/04/30 09:04:46 (6071) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:05:52 (6091) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:07:02 (6105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/30 09:07:02 (6105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/30 09:07:02 (6105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/04/30 09:12:03 (6124) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/30 09:12:03 (6124) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/30 09:12:03 (6124) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/04/30 09:16:13 (6137) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:17:04 (6150) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/30 09:17:04 (6150) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/30 09:17:04 (6150) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/04/30 09:22:05 (6165) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/30 09:22:05 (6165) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/30 09:22:05 (6165) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/04/30 09:26:15 (6269) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:27:06 (6299) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/30 09:27:06 (6299) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/30 09:27:06 (6299) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/04/30 09:29:02 (6307) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:32:07 (6379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/30 09:32:07 (6379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/30 09:32:07 (6379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/04/30 09:35:38 (6399) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:37:08 (6414) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/30 09:37:08 (6414) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/30 09:37:08 (6414) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/04/30 09:37:58 (6417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:42:09 (6443) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/30 09:42:09 (6443) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/30 09:42:09 (6443) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/04/30 09:45:12 (6457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:47:10 (6468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/30 09:47:10 (6468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/30 09:47:10 (6468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/04/30 09:52:11 (6478) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/30 09:52:11 (6478) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/30 09:52:11 (6478) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/04/30 09:54:53 (6515) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:56:54 (6584) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 09:57:13 (6606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/30 09:57:13 (6606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/30 09:57:13 (6606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/04/30 10:02:13 (6702) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/30 10:02:13 (6702) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/30 10:02:13 (6702) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/04/30 10:04:47 (6714) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:06:42 (6732) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:07:14 (6750) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/30 10:07:14 (6750) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/30 10:07:14 (6750) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/04/30 10:12:15 (6767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/30 10:12:15 (6767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/30 10:12:15 (6767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/04/30 10:14:23 (6773) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:17:16 (6793) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/30 10:17:16 (6793) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/30 10:17:16 (6793) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/04/30 10:22:17 (6807) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/30 10:22:17 (6807) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/30 10:22:17 (6807) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/04/30 10:24:55 (6841) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:26:22 (6852) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:27:18 (6892) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/30 10:27:18 (6892) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/30 10:27:18 (6892) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/04/30 10:32:19 (6963) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/30 10:32:19 (6963) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/30 10:32:19 (6963) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/04/30 10:34:51 (6977) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:36:46 (6994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:37:20 (7011) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/30 10:37:20 (7011) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/30 10:37:20 (7011) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/04/30 10:42:21 (7025) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/30 10:42:21 (7025) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/30 10:42:21 (7025) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/04/30 10:45:40 (7037) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:47:22 (7045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/30 10:47:22 (7045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/30 10:47:22 (7045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/04/30 10:52:23 (7064) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/30 10:52:23 (7064) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/30 10:52:23 (7064) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/04/30 10:55:24 (7098) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:56:43 (7109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 10:57:24 (7146) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/30 10:57:24 (7146) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/30 10:57:24 (7146) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/04/30 11:02:25 (7285) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/30 11:02:25 (7285) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/30 11:02:25 (7285) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/04/30 11:04:29 (7293) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:06:02 (7305) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:07:26 (7326) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/30 11:07:26 (7326) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/30 11:07:26 (7326) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/04/30 11:12:27 (7346) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/30 11:12:27 (7346) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/30 11:12:27 (7346) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/04/30 11:14:20 (7356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:17:28 (7371) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/30 11:17:28 (7371) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/30 11:17:28 (7371) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/04/30 11:22:29 (7385) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/30 11:22:29 (7385) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/30 11:22:29 (7385) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/04/30 11:25:17 (7425) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:25:18 (7431) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:27:30 (7473) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/30 11:27:30 (7473) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/30 11:27:30 (7473) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/04/30 11:32:31 (7549) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/30 11:32:31 (7549) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/30 11:32:31 (7549) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/04/30 11:33:37 (7558) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:35:48 (7580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:37:32 (7592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/30 11:37:32 (7592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/30 11:37:32 (7592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/04/30 11:42:33 (7611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/30 11:42:33 (7611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/30 11:42:33 (7611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/04/30 11:45:43 (7624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:47:35 (7632) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/30 11:47:35 (7632) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/30 11:47:35 (7632) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/04/30 11:52:19 (7656) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:52:35 (7674) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/30 11:52:35 (7674) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/30 11:52:35 (7674) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/04/30 11:55:06 (7707) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 11:57:36 (7735) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/30 11:57:36 (7735) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/30 11:57:36 (7735) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/04/30 12:02:37 (7944) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/30 12:02:37 (7944) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/30 12:02:37 (7944) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/04/30 12:04:17 (7950) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:05:10 (7961) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:07:38 (7982) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/30 12:07:38 (7982) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/30 12:07:38 (7982) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/04/30 12:12:39 (8003) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/30 12:12:39 (8003) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/30 12:12:39 (8003) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/04/30 12:14:37 (8009) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:17:40 (8031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/30 12:17:40 (8031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/30 12:17:40 (8031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/04/30 12:19:47 (8058) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:22:41 (8110) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/30 12:22:41 (8110) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/30 12:22:41 (8110) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/04/30 12:24:52 (8117) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:27:42 (8166) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/30 12:27:42 (8166) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/30 12:27:42 (8166) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/04/30 12:32:43 (8225) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/30 12:32:43 (8225) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/30 12:32:43 (8225) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/04/30 12:33:56 (8253) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:35:48 (8265) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:37:44 (8285) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/30 12:37:44 (8285) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/30 12:37:44 (8285) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/04/30 12:42:45 (8300) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/30 12:42:45 (8300) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/30 12:42:45 (8300) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/04/30 12:44:21 (8317) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:47:46 (8338) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/30 12:47:46 (8338) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/30 12:47:46 (8338) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/04/30 12:48:22 (8344) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:52:47 (8368) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/30 12:52:47 (8368) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/30 12:52:47 (8368) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/04/30 12:55:18 (8404) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 12:57:48 (8418) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/30 12:57:48 (8418) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/30 12:57:48 (8418) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/04/30 13:02:49 (8520) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/30 13:02:49 (8520) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/30 13:02:49 (8520) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/04/30 13:03:29 (8561) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:04:47 (8603) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:07:50 (8615) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/30 13:07:50 (8615) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/30 13:07:50 (8615) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/04/30 13:12:51 (8634) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/30 13:12:51 (8634) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/30 13:12:51 (8634) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/04/30 13:15:39 (8647) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:17:52 (8664) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/30 13:17:52 (8664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/30 13:17:52 (8664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/04/30 13:19:05 (8670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:22:53 (8701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/30 13:22:53 (8701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/30 13:22:53 (8701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/04/30 13:25:06 (8710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:27:54 (8749) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/30 13:27:54 (8749) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/30 13:27:54 (8749) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/04/30 13:32:55 (8779) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/30 13:32:55 (8779) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/30 13:32:55 (8779) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/04/30 13:35:18 (8825) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:36:17 (8858) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:37:57 (8880) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/30 13:37:57 (8880) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/30 13:37:57 (8880) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/04/30 13:42:58 (8901) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/30 13:42:58 (8901) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/30 13:42:58 (8901) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/04/30 13:45:38 (8909) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:47:59 (8923) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/30 13:47:59 (8923) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/30 13:47:59 (8923) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/04/30 13:49:43 (8931) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:53:00 (8958) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/30 13:53:00 (8958) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/30 13:53:00 (8958) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/04/30 13:55:15 (8966) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 13:58:01 (9005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/30 13:58:01 (9005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/30 13:58:01 (9005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/04/30 14:03:02 (9099) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/30 14:03:02 (9099) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/30 14:03:02 (9099) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/04/30 14:04:11 (9108) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:04:43 (9133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:08:03 (9203) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/30 14:08:03 (9203) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/30 14:08:03 (9203) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/04/30 14:13:04 (9225) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/30 14:13:04 (9225) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/30 14:13:04 (9225) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/04/30 14:14:58 (9231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:18:05 (9248) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/30 14:18:05 (9248) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/30 14:18:05 (9248) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/04/30 14:19:57 (9257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:23:06 (9287) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/30 14:23:06 (9287) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/30 14:23:06 (9287) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/04/30 14:24:38 (9292) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:28:07 (9336) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/30 14:28:07 (9336) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/30 14:28:07 (9336) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/04/30 14:33:08 (9367) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/30 14:33:08 (9367) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/30 14:33:08 (9367) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/04/30 14:35:09 (9376) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:35:59 (9390) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:38:09 (9468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/30 14:38:09 (9468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/30 14:38:09 (9468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/04/30 14:43:10 (9490) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/30 14:43:10 (9490) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/30 14:43:10 (9490) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/04/30 14:44:32 (9498) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:48:11 (9511) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/30 14:48:11 (9511) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/30 14:48:11 (9511) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/04/30 14:52:34 (9533) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:53:12 (9550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/30 14:53:12 (9550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/30 14:53:12 (9550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/04/30 14:55:16 (9559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 14:58:13 (9637) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/30 14:58:13 (9637) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/30 14:58:13 (9637) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/04/30 15:03:14 (9734) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/30 15:03:14 (9734) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/30 15:03:14 (9734) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/04/30 15:04:32 (9739) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:08:15 (9792) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/30 15:08:15 (9792) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/30 15:08:15 (9792) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/04/30 15:08:47 (9797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:13:16 (9857) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/30 15:13:16 (9857) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/30 15:13:16 (9857) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/04/30 15:14:32 (9865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:18:17 (9881) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/30 15:18:17 (9881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/30 15:18:17 (9881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/04/30 15:22:09 (9963) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:23:18 (9980) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/30 15:23:18 (9980) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/30 15:23:18 (9980) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/04/30 15:23:55 (9990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:28:20 (10032) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/30 15:28:20 (10032) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/30 15:28:20 (10032) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/04/30 15:33:04 (10066) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:33:21 (10072) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/30 15:33:21 (10072) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/30 15:33:21 (10072) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/04/30 15:37:10 (10089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:38:22 (10109) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/30 15:38:22 (10109) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/30 15:38:22 (10109) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/04/30 15:43:09 (10183) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:43:23 (10189) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/30 15:43:23 (10189) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/30 15:43:23 (10189) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/04/30 15:48:24 (10210) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/30 15:48:24 (10210) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/30 15:48:24 (10210) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/04/30 15:50:36 (10224) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:53:13 (10247) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 15:53:25 (10253) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/30 15:53:25 (10253) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/30 15:53:25 (10253) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/04/30 15:58:26 (10294) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/30 15:58:26 (10294) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/30 15:58:26 (10294) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/04/30 16:02:53 (10393) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:03:27 (10402) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/30 16:03:27 (10402) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/30 16:03:27 (10402) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/04/30 16:05:36 (10415) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:08:28 (10435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/30 16:08:28 (10435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/30 16:08:28 (10435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/04/30 16:12:12 (10511) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:13:29 (10524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/30 16:13:29 (10524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/30 16:13:29 (10524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/04/30 16:18:30 (10540) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/30 16:18:30 (10540) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/30 16:18:30 (10540) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/04/30 16:19:52 (10546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:21:54 (10573) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:23:31 (10581) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/30 16:23:31 (10581) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/30 16:23:31 (10581) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/04/30 16:28:32 (10622) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/30 16:28:32 (10622) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/30 16:28:32 (10622) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/04/30 16:32:32 (10655) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:33:33 (10665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/30 16:33:33 (10665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/30 16:33:33 (10665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/04/30 16:37:43 (10680) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:38:34 (10697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/30 16:38:34 (10697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/30 16:38:34 (10697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/04/30 16:42:32 (10773) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:43:35 (10786) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/30 16:43:35 (10786) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/30 16:43:35 (10786) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/04/30 16:48:36 (10801) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/30 16:48:36 (10801) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/30 16:48:36 (10801) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/04/30 16:48:41 (10802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:52:58 (10832) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 16:53:37 (10841) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/30 16:53:37 (10841) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/30 16:53:37 (10841) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/04/30 16:58:38 (10879) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/30 16:58:38 (10879) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/30 16:58:38 (10879) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/04/30 17:03:24 (10979) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:03:39 (10988) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/30 17:03:39 (10988) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/30 17:03:39 (10988) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/04/30 17:05:34 (10995) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:08:41 (11021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/30 17:08:41 (11021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/30 17:08:41 (11021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/04/30 17:13:27 (11074) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:13:42 (11102) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/30 17:13:42 (11102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/30 17:13:42 (11102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/04/30 17:18:43 (11123) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/30 17:18:43 (11123) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/30 17:18:43 (11123) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/04/30 17:21:20 (11135) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:23:44 (11160) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/30 17:23:44 (11160) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/30 17:23:44 (11160) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/04/30 17:24:19 (11165) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:28:45 (11209) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/30 17:28:45 (11209) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/30 17:28:45 (11209) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/04/30 17:32:40 (11245) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:33:46 (11262) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/30 17:33:46 (11262) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/30 17:33:46 (11262) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/04/30 17:34:14 (11267) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:38:47 (11286) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/30 17:38:47 (11286) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/30 17:38:47 (11286) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/04/30 17:43:35 (11307) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:43:48 (11348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/30 17:43:48 (11348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/30 17:43:48 (11348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/04/30 17:48:49 (11386) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/30 17:48:49 (11386) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/30 17:48:49 (11386) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/04/30 17:50:57 (11397) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:53:50 (11421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/30 17:53:50 (11421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/30 17:53:50 (11421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/04/30 17:54:18 (11426) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 17:58:51 (11468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/30 17:58:51 (11468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/30 17:58:51 (11468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/04/30 18:02:14 (11571) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:03:52 (11588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/30 18:03:52 (11588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/30 18:03:52 (11588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/04/30 18:04:07 (11593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:08:53 (11613) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/30 18:08:53 (11613) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/30 18:08:53 (11613) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/04/30 18:13:24 (11631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:13:54 (11640) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/30 18:13:54 (11640) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/30 18:13:54 (11640) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/04/30 18:18:55 (11716) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/30 18:18:55 (11716) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/30 18:18:55 (11716) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/04/30 18:22:54 (11732) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:23:56 (11754) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:23:56 (11754) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 18:23:56 (11754) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 18:23:56 (11754) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 18:24:13 (11761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:28:57 (11799) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/30 18:28:57 (11799) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/30 18:28:57 (11799) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/04/30 18:31:35 (11838) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:33:15 (11859) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:33:58 (11868) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:33:58 (11868) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 18:33:58 (11868) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 18:33:58 (11868) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 18:38:59 (11880) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/30 18:38:59 (11880) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/30 18:38:59 (11880) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/04/30 18:42:25 (11900) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:44:00 (11907) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:44:00 (11907) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 18:44:00 (11907) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 18:44:00 (11907) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 18:49:01 (11985) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/30 18:49:01 (11985) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/30 18:49:01 (11985) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/04/30 18:52:43 (12004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:52:47 (12010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 18:54:02 (12027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/30 18:54:02 (12027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/30 18:54:02 (12027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/04/30 18:59:03 (12065) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/30 18:59:03 (12065) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/30 18:59:03 (12065) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/04/30 19:00:05 (12141) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:02:01 (12190) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:04:05 (12199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/30 19:04:05 (12199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/30 19:04:05 (12199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/04/30 19:09:05 (12207) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/30 19:09:05 (12207) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/30 19:09:05 (12207) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/04/30 19:12:34 (12227) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:14:06 (12234) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:14:06 (12234) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 19:14:06 (12234) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 19:14:06 (12234) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 19:19:07 (12308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/30 19:19:07 (12308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/30 19:19:07 (12308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/04/30 19:21:55 (12328) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:22:30 (12339) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:24:08 (12356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:24:08 (12356) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 19:24:08 (12356) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 19:24:08 (12356) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 19:29:09 (12401) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/30 19:29:09 (12401) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/30 19:29:09 (12401) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/04/30 19:31:38 (12441) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:32:08 (12460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:34:10 (12471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:34:10 (12471) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 19:34:10 (12471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 19:34:10 (12471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 19:39:11 (12479) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/30 19:39:11 (12479) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/30 19:39:11 (12479) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/04/30 19:43:08 (12496) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:44:12 (12504) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:44:12 (12504) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 19:44:12 (12504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 19:44:12 (12504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 19:49:13 (12553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/30 19:49:13 (12553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/30 19:49:13 (12553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/04/30 19:52:32 (12597) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:52:56 (12616) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 19:54:14 (12624) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/30 19:54:14 (12624) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/30 19:54:14 (12624) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/04/30 19:59:15 (12665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/30 19:59:15 (12665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/30 19:59:15 (12665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/04/30 20:01:31 (12766) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:03:15 (12791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:04:16 (12798) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/30 20:04:16 (12798) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/30 20:04:16 (12798) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/04/30 20:09:17 (12809) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/30 20:09:17 (12809) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/30 20:09:17 (12809) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/04/30 20:12:27 (12824) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:14:18 (12832) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/30 20:14:18 (12832) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/30 20:14:18 (12832) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/04/30 20:19:19 (12849) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/30 20:19:19 (12849) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/30 20:19:19 (12849) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/04/30 20:21:31 (12923) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:22:21 (12934) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:24:20 (12954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/30 20:24:20 (12954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/30 20:24:20 (12954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/04/30 20:29:21 (12990) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/30 20:29:21 (12990) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/30 20:29:21 (12990) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/04/30 20:31:43 (13025) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:32:02 (13047) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:34:22 (13064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:34:22 (13064) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 20:34:22 (13064) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 20:34:22 (13064) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 20:39:23 (13075) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/30 20:39:23 (13075) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/30 20:39:23 (13075) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/04/30 20:41:33 (13088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:44:24 (13102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:44:25 (13102) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 20:44:25 (13102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 20:44:25 (13102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 20:49:25 (13117) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/30 20:49:25 (13117) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/30 20:49:25 (13117) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/04/30 20:51:06 (13166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:54:26 (13201) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/30 20:54:26 (13201) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/30 20:54:26 (13201) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/04/30 20:55:04 (13206) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:58:31 (13261) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 20:59:27 (13282) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/30 20:59:27 (13282) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/30 20:59:27 (13282) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/04/30 21:00:16 (13343) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:04:28 (13398) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/30 21:04:28 (13398) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/30 21:04:28 (13398) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/04/30 21:09:29 (13408) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/30 21:09:29 (13408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/30 21:09:29 (13408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/04/30 21:09:42 (13412) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:14:30 (13435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/30 21:14:30 (13435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/30 21:14:30 (13435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/04/30 21:19:31 (13447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:19:31 (13447) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 21:19:31 (13447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 21:19:31 (13447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 21:20:07 (13457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:24:32 (13538) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/30 21:24:32 (13538) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/30 21:24:32 (13538) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/04/30 21:25:38 (13547) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:27:43 (13571) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:29:12 (13617) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:29:33 (13624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:29:33 (13624) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 21:29:33 (13624) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 21:29:33 (13624) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 21:34:34 (13663) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/30 21:34:34 (13663) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/30 21:34:34 (13663) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/04/30 21:39:35 (13676) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:39:35 (13676) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 21:39:35 (13676) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 21:39:35 (13676) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 21:40:07 (13688) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:44:36 (13707) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/30 21:44:36 (13707) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/30 21:44:36 (13707) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/04/30 21:49:37 (13713) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/30 21:49:37 (13713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/30 21:49:37 (13713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/04/30 21:51:06 (13724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:54:38 (13809) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/30 21:54:38 (13809) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/30 21:54:38 (13809) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/04/30 21:55:31 (13815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:56:20 (13836) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:59:39 (13881) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 21:59:39 (13881) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 21:59:39 (13881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 21:59:39 (13881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 22:01:47 (13986) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:04:40 (13998) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/30 22:04:40 (13998) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/30 22:04:40 (13998) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/04/30 22:09:41 (14006) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:09:41 (14006) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 22:09:41 (14006) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 22:09:41 (14006) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 22:11:11 (14020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:14:42 (14033) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/30 22:14:42 (14033) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/30 22:14:42 (14033) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/04/30 22:19:43 (14044) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:19:44 (14044) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 22:19:44 (14044) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 22:19:44 (14044) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 22:21:31 (14067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:24:44 (14124) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/30 22:24:44 (14124) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/30 22:24:44 (14124) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/04/30 22:25:01 (14125) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:27:08 (14169) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:29:45 (14212) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/30 22:29:45 (14212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/30 22:29:45 (14212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/04/30 22:30:41 (14231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:34:46 (14263) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/30 22:34:46 (14263) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/30 22:34:46 (14263) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/04/30 22:39:43 (14274) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:39:47 (14280) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:39:47 (14280) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 22:39:47 (14280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 22:39:47 (14280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 22:44:48 (14303) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/30 22:44:48 (14303) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/30 22:44:48 (14303) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/04/30 22:49:49 (14313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:49:49 (14313) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 22:49:49 (14313) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 22:49:49 (14313) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 22:49:55 (14316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:54:50 (14358) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/30 22:54:50 (14358) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/30 22:54:50 (14358) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/04/30 22:54:54 (14359) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:55:22 (14377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:59:51 (14520) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 22:59:51 (14520) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 22:59:51 (14520) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 22:59:51 (14520) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 23:00:16 (14579) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:04:52 (14643) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/30 23:04:52 (14643) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/30 23:04:52 (14643) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/04/30 23:09:53 (14649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:09:53 (14649) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 23:09:53 (14649) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 23:09:53 (14649) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 23:10:46 (14660) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:14:54 (14677) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/30 23:14:54 (14677) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/30 23:14:54 (14677) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/04/30 23:19:55 (14686) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:19:55 (14686) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/04/30 23:19:55 (14686) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/04/30 23:19:55 (14686) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/04/30 23:21:24 (14766) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:23:00 (14797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:24:47 (14822) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:24:56 (14838) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/30 23:24:56 (14838) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/30 23:24:56 (14838) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/04/30 23:29:57 (14923) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/30 23:29:57 (14923) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/30 23:29:57 (14923) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/04/30 23:32:21 (14960) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:34:58 (14974) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/30 23:34:58 (14974) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/30 23:34:58 (14974) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/04/30 23:39:59 (14982) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/30 23:39:59 (14982) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/30 23:39:59 (14982) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/04/30 23:41:38 (14994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:45:00 (15010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/30 23:45:00 (15010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/30 23:45:00 (15010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/04/30 23:50:01 (15027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/30 23:50:01 (15027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/30 23:50:01 (15027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/04/30 23:51:30 (15036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:52:12 (15049) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/04/30 23:55:02 (15086) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/30 23:55:02 (15086) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/30 23:55:02 (15086) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/04/30 23:56:26 (15093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:00:03 (15250) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/01 00:00:03 (15250) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/01 00:00:03 (15250) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/01 00:01:28 (15287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:05:04 (15317) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/01 00:05:04 (15317) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/01 00:05:04 (15317) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/01 00:10:05 (15330) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/01 00:10:05 (15330) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/01 00:10:05 (15330) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/01 00:11:18 (15338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:15:07 (15351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/01 00:15:07 (15351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/01 00:15:07 (15351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/01 00:20:08 (15374) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/01 00:20:08 (15374) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/01 00:20:08 (15374) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/01 00:20:30 (15384) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:20:36 (15390) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:24:10 (15418) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:25:09 (15435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/01 00:25:09 (15435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/01 00:25:09 (15435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/01 00:30:10 (15537) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/01 00:30:10 (15537) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/01 00:30:10 (15537) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/01 00:30:44 (15542) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:35:11 (15574) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/01 00:35:11 (15574) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/01 00:35:11 (15574) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/01 00:40:12 (15587) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/01 00:40:12 (15587) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/01 00:40:12 (15587) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/01 00:41:01 (15592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:45:13 (15607) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/01 00:45:13 (15607) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/01 00:45:13 (15607) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/01 00:50:14 (15631) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/01 00:50:14 (15631) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/01 00:50:14 (15631) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/01 00:50:16 (15632) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:51:31 (15647) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:53:59 (15678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 00:55:15 (15695) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/01 00:55:15 (15695) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/01 00:55:15 (15695) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/01 01:00:16 (15818) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/01 01:00:16 (15818) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/01 01:00:16 (15818) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/01 01:00:21 (15819) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:05:24 (15961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/01 01:05:24 (15961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/01 01:05:24 (15961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/01 01:05:42 (16024) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:06:57 (16051) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:08:14 (16078) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:10:25 (16104) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/01 01:10:25 (16104) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/01 01:10:25 (16104) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/01 01:15:26 (16110) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/01 01:15:26 (16110) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/01 01:15:26 (16110) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/01 01:16:02 (16118) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:20:27 (16139) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/01 01:20:27 (16139) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/01 01:20:27 (16139) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/01 01:25:28 (16149) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/01 01:25:28 (16149) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/01 01:25:28 (16149) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/01 01:25:38 (16150) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:30:29 (16199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/01 01:30:29 (16199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/01 01:30:29 (16199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/01 01:35:30 (16292) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/01 01:35:30 (16292) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/01 01:35:30 (16292) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/01 01:36:02 (16303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:36:06 (16319) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:38:40 (16336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:40:31 (16360) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/01 01:40:31 (16360) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/01 01:40:31 (16360) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/01 01:45:32 (16366) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/01 01:45:32 (16366) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/01 01:45:32 (16366) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/01 01:45:48 (16370) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:50:33 (16393) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/01 01:50:33 (16393) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/01 01:50:33 (16393) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/01 01:55:29 (16401) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 01:55:34 (16408) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/01 01:55:34 (16408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/01 01:55:34 (16408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/01 02:00:35 (16505) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/01 02:00:35 (16505) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/01 02:00:35 (16505) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/01 02:05:36 (16621) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/01 02:05:36 (16621) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/01 02:05:36 (16621) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/01 02:05:44 (16622) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:08:25 (16648) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:09:18 (16666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:10:37 (16694) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/01 02:10:37 (16694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/01 02:10:37 (16694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/01 02:15:33 (16706) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:15:38 (16712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/01 02:15:38 (16712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/01 02:15:38 (16712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/01 02:20:39 (16730) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/01 02:20:39 (16730) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/01 02:20:39 (16730) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/01 02:25:00 (16741) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:25:40 (16748) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/01 02:25:40 (16748) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/01 02:25:40 (16748) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/01 02:30:41 (16848) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/01 02:30:41 (16848) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/01 02:30:41 (16848) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/01 02:35:09 (16941) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:35:42 (16948) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/01 02:35:42 (16948) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/01 02:35:42 (16948) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/01 02:37:59 (16964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:39:48 (16986) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:40:43 (17009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/01 02:40:43 (17009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/01 02:40:43 (17009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/01 02:44:50 (17020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:45:44 (17027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/01 02:45:44 (17027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/01 02:45:44 (17027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/01 02:50:45 (17043) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/01 02:50:45 (17043) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/01 02:50:45 (17043) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/01 02:54:35 (17054) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 02:55:46 (17061) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/01 02:55:46 (17061) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/01 02:55:46 (17061) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/01 03:00:47 (17149) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/01 03:00:47 (17149) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/01 03:00:47 (17149) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/01 03:04:38 (17211) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:05:48 (17256) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/01 03:05:48 (17256) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/01 03:05:48 (17256) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/01 03:06:49 (17290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:10:49 (17324) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/01 03:10:49 (17324) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/01 03:10:49 (17324) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/01 03:11:28 (17329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:13:49 (17353) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:15:50 (17361) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/01 03:15:50 (17361) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/01 03:15:50 (17361) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/01 03:20:51 (17378) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/01 03:20:51 (17378) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/01 03:20:51 (17378) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/01 03:24:21 (17388) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:25:52 (17396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/01 03:25:52 (17396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/01 03:25:52 (17396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/01 03:30:53 (17436) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/01 03:30:53 (17436) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/01 03:30:53 (17436) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/01 03:34:10 (17471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:34:51 (17491) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:35:54 (17501) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/01 03:35:54 (17501) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/01 03:35:54 (17501) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/01 03:40:04 (17599) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:40:55 (17616) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/01 03:40:55 (17616) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/01 03:40:55 (17616) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/01 03:45:16 (17627) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:45:56 (17634) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/01 03:45:56 (17634) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/01 03:45:56 (17634) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/01 03:50:57 (17969) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/01 03:50:57 (17969) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/01 03:50:57 (17969) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/01 03:55:39 (17980) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 03:55:58 (17986) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/01 03:55:58 (17986) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/01 03:55:58 (17986) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/01 04:00:59 (18074) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/01 04:00:59 (18074) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/01 04:00:59 (18074) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/01 04:02:01 (18097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:05:11 (18143) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:06:00 (18150) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/01 04:06:00 (18150) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/01 04:06:00 (18150) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/01 04:11:01 (18234) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/01 04:11:01 (18234) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/01 04:11:01 (18234) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/01 04:11:18 (18235) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:14:43 (18258) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:16:02 (18272) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/01 04:16:02 (18272) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/01 04:16:02 (18272) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/01 04:21:03 (18291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/01 04:21:03 (18291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/01 04:21:03 (18291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/01 04:23:43 (18298) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:26:04 (18306) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/01 04:26:04 (18306) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/01 04:26:04 (18306) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/01 04:31:05 (18348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/01 04:31:05 (18348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/01 04:31:05 (18348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/01 04:31:52 (18356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:34:00 (18398) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:36:06 (18419) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/01 04:36:06 (18419) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/01 04:36:06 (18419) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/01 04:41:07 (18494) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/01 04:41:07 (18494) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/01 04:41:07 (18494) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/01 04:41:38 (18499) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:43:45 (18521) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:46:08 (18529) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/01 04:46:08 (18529) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/01 04:46:08 (18529) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/01 04:51:09 (18547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/01 04:51:09 (18547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/01 04:51:09 (18547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/01 04:53:28 (18553) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 04:56:10 (18562) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/01 04:56:10 (18562) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/01 04:56:10 (18562) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/01 05:01:11 (18673) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/01 05:01:11 (18673) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/01 05:01:11 (18673) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/01 05:02:19 (18679) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:04:16 (18723) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:06:12 (18737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/01 05:06:12 (18737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/01 05:06:12 (18737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/01 05:11:13 (18820) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/01 05:11:13 (18820) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/01 05:11:13 (18820) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/01 05:12:27 (18826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:13:22 (18846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:16:14 (18855) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/01 05:16:14 (18855) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/01 05:16:14 (18855) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/01 05:21:16 (18878) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/01 05:21:16 (18878) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/01 05:21:16 (18878) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/01 05:22:55 (18884) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:26:17 (18893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/01 05:26:17 (18893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/01 05:26:17 (18893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/01 05:29:49 (18911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:31:18 (18956) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/01 05:31:18 (18956) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/01 05:31:18 (18956) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/01 05:33:44 (18990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:36:19 (19002) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/01 05:36:19 (19002) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/01 05:36:19 (19002) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/01 05:41:20 (19062) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/01 05:41:20 (19062) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/01 05:41:20 (19062) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/01 05:44:27 (19095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:44:38 (19101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:46:21 (19119) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/01 05:46:21 (19119) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/01 05:46:21 (19119) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/01 05:51:22 (19138) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/01 05:51:22 (19138) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/01 05:51:22 (19138) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/01 05:54:37 (19145) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 05:56:23 (19153) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/01 05:56:23 (19153) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/01 05:56:23 (19153) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/01 05:59:52 (19166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:01:24 (19286) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/01 06:01:24 (19286) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/01 06:01:24 (19286) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/01 06:05:25 (19323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:06:25 (19330) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/01 06:06:25 (19330) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/01 06:06:25 (19330) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/01 06:11:26 (19353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/01 06:11:26 (19353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/01 06:11:26 (19353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/01 06:14:29 (19426) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:14:41 (19432) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:16:27 (19450) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/01 06:16:27 (19450) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/01 06:16:27 (19450) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/01 06:21:28 (19471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/01 06:21:28 (19471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/01 06:21:28 (19471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/01 06:24:39 (19478) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:26:29 (19486) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/01 06:26:29 (19486) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/01 06:26:29 (19486) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/01 06:31:11 (19531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:31:30 (19547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/01 06:31:30 (19547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/01 06:31:30 (19547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/01 06:35:18 (19586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:36:31 (19593) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/01 06:36:31 (19593) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/01 06:36:31 (19593) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/01 06:41:32 (19611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/01 06:41:32 (19611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/01 06:41:32 (19611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/01 06:45:15 (19684) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:45:35 (19703) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:46:33 (19710) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/01 06:46:33 (19710) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/01 06:46:33 (19710) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/01 06:51:34 (19728) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/01 06:51:34 (19728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/01 06:51:34 (19728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/01 06:55:04 (19736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 06:56:35 (19791) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/01 06:56:35 (19791) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/01 06:56:35 (19791) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/01 07:01:36 (19900) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/01 07:01:36 (19900) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/01 07:01:36 (19900) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/01 07:02:46 (19906) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:04:07 (19952) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:06:37 (19970) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/01 07:06:37 (19970) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/01 07:06:37 (19970) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/01 07:11:38 (19988) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/01 07:11:38 (19988) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/01 07:11:38 (19988) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/01 07:12:14 (19994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:14:19 (20053) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:16:40 (20093) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/01 07:16:40 (20093) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/01 07:16:40 (20093) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/01 07:21:41 (20112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/01 07:21:41 (20112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/01 07:21:41 (20112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/01 07:24:06 (20186) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:26:42 (20197) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/01 07:26:42 (20197) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/01 07:26:42 (20197) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/01 07:31:40 (20243) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:31:43 (20259) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/01 07:31:43 (20259) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/01 07:31:43 (20259) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/01 07:34:25 (20289) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:36:44 (20297) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/01 07:36:44 (20297) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/01 07:36:44 (20297) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/01 07:41:45 (20320) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/01 07:41:45 (20320) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/01 07:41:45 (20320) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/01 07:42:54 (20327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:45:21 (20355) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:46:46 (20422) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/01 07:46:46 (20422) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/01 07:46:46 (20422) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/01 07:51:47 (20438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/01 07:51:47 (20438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/01 07:51:47 (20438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/01 07:55:41 (20446) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 07:56:48 (20453) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/01 07:56:48 (20453) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/01 07:56:48 (20453) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/01 07:59:59 (20471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:01:49 (20585) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/01 08:01:49 (20585) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/01 08:01:49 (20585) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/01 08:04:55 (20618) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:06:50 (20633) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/01 08:06:50 (20633) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/01 08:06:50 (20633) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/01 08:10:56 (20652) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:11:51 (20669) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/01 08:11:51 (20669) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/01 08:11:51 (20669) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/01 08:15:40 (20687) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:16:52 (20735) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/01 08:16:52 (20735) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/01 08:16:52 (20735) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/01 08:21:53 (20772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/01 08:21:53 (20772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/01 08:21:53 (20772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/01 08:24:38 (20778) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:26:54 (20794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/01 08:26:54 (20794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/01 08:26:54 (20794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/01 08:28:50 (20803) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:31:55 (20854) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/01 08:31:55 (20854) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/01 08:31:55 (20854) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/01 08:34:15 (20865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:36:56 (20899) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/01 08:36:56 (20899) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/01 08:36:56 (20899) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/01 08:41:52 (20918) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:41:57 (20934) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/01 08:41:57 (20934) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/01 08:41:57 (20934) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/01 08:44:13 (20940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:46:59 (20958) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/01 08:46:59 (20958) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/01 08:46:59 (20958) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/01 08:52:00 (21031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/01 08:52:00 (21031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/01 08:52:00 (21031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/01 08:53:43 (21036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 08:57:01 (21049) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/01 08:57:01 (21049) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/01 08:57:01 (21049) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/01 08:57:29 (21054) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:02:02 (21183) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/01 09:02:02 (21183) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/01 09:02:02 (21183) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/01 09:03:21 (21190) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:07:03 (21231) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/01 09:07:03 (21231) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/01 09:07:03 (21231) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/01 09:10:09 (21247) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:12:04 (21265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/01 09:12:04 (21265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/01 09:12:04 (21265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/01 09:12:28 (21271) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:17:05 (21292) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/01 09:17:05 (21292) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/01 09:17:05 (21292) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/01 09:22:06 (21365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/01 09:22:06 (21365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/01 09:22:06 (21365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/01 09:22:45 (21371) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:26:49 (21388) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:27:07 (21405) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/01 09:27:07 (21405) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/01 09:27:07 (21405) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/01 09:31:59 (21451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:32:08 (21457) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/01 09:32:08 (21457) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/01 09:32:08 (21457) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/01 09:37:09 (21496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/01 09:37:09 (21496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/01 09:37:09 (21496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/01 09:37:57 (21502) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:41:11 (21531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:42:10 (21538) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/01 09:42:10 (21538) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/01 09:42:10 (21538) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/01 09:47:11 (21553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/01 09:47:11 (21553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/01 09:47:11 (21553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/01 09:52:02 (21629) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:52:12 (21635) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/01 09:52:12 (21635) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/01 09:52:12 (21635) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/01 09:57:05 (21654) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 09:57:13 (21670) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/01 09:57:13 (21670) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/01 09:57:13 (21670) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/01 10:01:07 (21754) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:02:14 (21789) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/01 10:02:14 (21789) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/01 10:02:14 (21789) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/01 10:04:50 (21815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:07:15 (21846) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/01 10:07:15 (21846) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/01 10:07:15 (21846) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/01 10:10:41 (21857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:12:16 (21865) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/01 10:12:16 (21865) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/01 10:12:16 (21865) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/01 10:17:17 (21886) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/01 10:17:17 (21886) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/01 10:17:17 (21886) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/01 10:21:15 (21936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:22:18 (21968) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/01 10:22:18 (21968) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/01 10:22:18 (21968) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/01 10:26:24 (21980) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:27:19 (22000) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/01 10:27:19 (22000) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/01 10:27:19 (22000) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/01 10:31:39 (22016) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:32:20 (22047) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/01 10:32:20 (22047) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/01 10:32:20 (22047) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/01 10:34:16 (22057) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:37:22 (22099) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/01 10:37:22 (22099) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/01 10:37:22 (22099) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/01 10:40:55 (22117) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:42:23 (22125) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/01 10:42:23 (22125) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/01 10:42:23 (22125) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/01 10:47:24 (22144) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/01 10:47:24 (22144) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/01 10:47:24 (22144) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/01 10:51:29 (22159) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:52:25 (22201) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/01 10:52:25 (22201) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/01 10:52:25 (22201) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/01 10:56:53 (22242) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 10:57:26 (22259) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/01 10:57:26 (22259) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/01 10:57:26 (22259) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/01 11:01:01 (22333) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:01:22 (22356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:02:27 (22373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/01 11:02:27 (22373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/01 11:02:27 (22373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/01 11:07:28 (22433) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/01 11:07:28 (22433) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/01 11:07:28 (22433) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/01 11:11:11 (22455) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:12:29 (22462) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/01 11:12:29 (22462) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/01 11:12:29 (22462) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/01 11:17:30 (22476) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/01 11:17:30 (22476) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/01 11:17:30 (22476) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/01 11:21:23 (22491) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:22:31 (22498) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/01 11:22:31 (22498) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/01 11:22:31 (22498) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/01 11:27:32 (22570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/01 11:27:32 (22570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/01 11:27:32 (22570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/01 11:29:26 (22583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:29:56 (22600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:30:27 (22624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:32:33 (22638) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/01 11:32:33 (22638) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/01 11:32:33 (22638) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/01 11:37:34 (22694) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/01 11:37:34 (22694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/01 11:37:34 (22694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/01 11:40:43 (22710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:42:35 (22722) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/01 11:42:35 (22722) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/01 11:42:35 (22722) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/01 11:47:36 (22734) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/01 11:47:36 (22734) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/01 11:47:36 (22734) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/01 11:50:00 (22747) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:52:37 (22760) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/01 11:52:37 (22760) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/01 11:52:37 (22760) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/01 11:57:38 (22831) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/01 11:57:38 (22831) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/01 11:57:38 (22831) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/01 11:58:22 (22837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 11:59:46 (22865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:00:28 (22938) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:02:39 (22965) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/01 12:02:39 (22965) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/01 12:02:39 (22965) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/01 12:07:40 (23022) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/01 12:07:40 (23022) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/01 12:07:40 (23022) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/01 12:10:13 (23039) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:12:41 (23051) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/01 12:12:41 (23051) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/01 12:12:41 (23051) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/01 12:17:42 (23070) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/01 12:17:42 (23070) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/01 12:17:42 (23070) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/01 12:20:52 (23084) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:22:44 (23092) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/01 12:22:44 (23092) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/01 12:22:44 (23092) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/01 12:27:44 (23167) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/01 12:27:44 (23167) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/01 12:27:44 (23167) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/01 12:29:47 (23176) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:30:32 (23207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:30:49 (23213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:32:45 (23231) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/01 12:32:45 (23231) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/01 12:32:45 (23231) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/01 12:37:46 (23288) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/01 12:37:46 (23288) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/01 12:37:46 (23288) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/01 12:40:44 (23304) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:42:47 (23312) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/01 12:42:47 (23312) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/01 12:42:47 (23312) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/01 12:47:48 (23331) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/01 12:47:48 (23331) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/01 12:47:48 (23331) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/01 12:51:03 (23345) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 12:52:49 (23355) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/01 12:52:49 (23355) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/01 12:52:49 (23355) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/01 12:57:50 (23408) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/01 12:57:50 (23408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/01 12:57:50 (23408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/01 12:59:30 (23438) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:00:16 (23512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:01:05 (23539) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:02:51 (23557) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/01 13:02:51 (23557) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/01 13:02:51 (23557) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/01 13:07:52 (23612) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/01 13:07:52 (23612) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/01 13:07:52 (23612) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/01 13:09:36 (23620) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:12:53 (23641) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/01 13:12:53 (23641) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/01 13:12:53 (23641) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/01 13:17:54 (23659) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/01 13:17:54 (23659) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/01 13:17:54 (23659) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/01 13:19:49 (23668) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:22:55 (23681) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/01 13:22:55 (23681) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/01 13:22:55 (23681) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/01 13:27:56 (23697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/01 13:27:56 (23697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/01 13:27:56 (23697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/01 13:29:51 (23767) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:31:41 (23783) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:32:57 (23804) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/01 13:32:57 (23804) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/01 13:32:57 (23804) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/01 13:33:07 (23806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:37:58 (23877) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/01 13:37:58 (23877) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/01 13:37:58 (23877) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/01 13:39:07 (23886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:42:59 (23904) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/01 13:42:59 (23904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/01 13:42:59 (23904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/01 13:48:00 (23918) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/01 13:48:00 (23918) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/01 13:48:00 (23918) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/01 13:50:04 (23931) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 13:53:01 (23940) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/01 13:53:01 (23940) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/01 13:53:01 (23940) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/01 13:58:02 (23956) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/01 13:58:02 (23956) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/01 13:58:02 (23956) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/01 13:59:31 (24002) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:00:30 (24091) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:03:03 (24126) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/01 14:03:03 (24126) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/01 14:03:03 (24126) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/01 14:05:31 (24164) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:08:04 (24203) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/01 14:08:04 (24203) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/01 14:08:04 (24203) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/01 14:09:09 (24211) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:13:05 (24230) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/01 14:13:05 (24230) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/01 14:13:05 (24230) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/01 14:18:06 (24248) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/01 14:18:06 (24248) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/01 14:18:06 (24248) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/01 14:18:33 (24253) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:23:07 (24269) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/01 14:23:07 (24269) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/01 14:23:07 (24269) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/01 14:28:08 (24285) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/01 14:28:08 (24285) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/01 14:28:08 (24285) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/01 14:28:51 (24290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:29:52 (24304) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:33:09 (24393) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/01 14:33:09 (24393) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/01 14:33:09 (24393) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/01 14:33:18 (24395) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:38:10 (24470) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/01 14:38:10 (24470) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/01 14:38:10 (24470) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/01 14:39:14 (24478) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:43:11 (24492) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/01 14:43:11 (24492) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/01 14:43:11 (24492) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/01 14:48:12 (24511) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/01 14:48:12 (24511) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/01 14:48:12 (24511) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/01 14:49:12 (24516) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 14:53:13 (24532) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/01 14:53:13 (24532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/01 14:53:13 (24532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/01 14:58:14 (24598) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/01 14:58:14 (24598) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/01 14:58:14 (24598) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/01 15:00:01 (24611) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:00:25 (24672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:02:09 (24748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:03:15 (24788) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/01 15:03:15 (24788) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/01 15:03:15 (24788) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/01 15:08:16 (24839) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/01 15:08:16 (24839) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/01 15:08:16 (24839) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/01 15:09:04 (24845) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:13:17 (24864) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/01 15:13:17 (24864) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/01 15:13:17 (24864) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/01 15:18:18 (24885) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/01 15:18:18 (24885) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/01 15:18:18 (24885) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/01 15:18:22 (24886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:23:19 (24904) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/01 15:23:19 (24904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/01 15:23:19 (24904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/01 15:27:23 (24989) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:28:20 (24997) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/01 15:28:20 (24997) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/01 15:28:20 (24997) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/01 15:31:38 (25014) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:32:05 (25034) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:33:21 (25087) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/01 15:33:21 (25087) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/01 15:33:21 (25087) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/01 15:37:05 (25170) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:38:22 (25181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/01 15:38:22 (25181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/01 15:38:22 (25181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/01 15:43:23 (25191) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/01 15:43:23 (25191) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/01 15:43:23 (25191) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/01 15:46:43 (25209) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:48:24 (25220) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/01 15:48:24 (25220) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/01 15:48:24 (25220) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/01 15:53:25 (25230) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/01 15:53:25 (25230) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/01 15:53:25 (25230) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/01 15:57:03 (25250) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 15:58:26 (25258) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/01 15:58:26 (25258) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/01 15:58:26 (25258) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/01 15:59:43 (25266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:00:52 (25340) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:03:27 (25379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/01 16:03:27 (25379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/01 16:03:27 (25379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/01 16:07:30 (25482) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:08:29 (25505) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/01 16:08:29 (25505) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/01 16:08:29 (25505) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/01 16:13:29 (25520) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/01 16:13:29 (25520) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/01 16:13:29 (25520) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/01 16:18:26 (25544) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:18:30 (25550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/01 16:18:30 (25550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/01 16:18:30 (25550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/01 16:23:31 (25564) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/01 16:23:31 (25564) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/01 16:23:31 (25564) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/01 16:27:45 (25582) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:28:04 (25590) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:28:32 (25611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/01 16:28:32 (25611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/01 16:28:32 (25611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/01 16:28:42 (25612) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:33:33 (25639) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/01 16:33:33 (25639) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/01 16:33:33 (25639) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/01 16:37:07 (25735) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:38:34 (25753) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/01 16:38:34 (25753) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/01 16:38:34 (25753) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/01 16:43:35 (25775) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/01 16:43:35 (25775) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/01 16:43:35 (25775) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/01 16:47:40 (25788) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:48:36 (25798) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/01 16:48:36 (25798) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/01 16:48:36 (25798) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/01 16:53:37 (25812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/01 16:53:37 (25812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/01 16:53:37 (25812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/01 16:56:40 (25828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:57:03 (25835) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:58:22 (25857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 16:58:38 (25875) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/01 16:58:38 (25875) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/01 16:58:38 (25875) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/01 17:03:39 (25953) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/01 17:03:39 (25953) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/01 17:03:39 (25953) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/01 17:07:06 (26034) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 17:08:40 (26088) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/01 17:08:40 (26088) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/01 17:08:40 (26088) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/01 17:13:41 (26102) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/01 17:13:41 (26102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/01 17:13:41 (26102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/01 17:16:35 (26115) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 17:18:42 (26125) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/01 17:18:42 (26125) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/01 17:18:42 (26125) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/01 17:23:43 (26142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/01 17:23:43 (26142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/01 17:23:43 (26142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/01 17:26:21 (26154) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 17:27:29 (26165) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 17:28:44 (26185) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/01 17:28:44 (26185) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/01 17:28:44 (26185) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/01 17:31:40 (26197) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 17:33:45 (26219) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/01 17:33:45 (26219) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/01 17:33:45 (26219) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/01 17:36:24 (26262) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 17:38:46 (26354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/01 17:38:46 (26354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/01 17:38:46 (26354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/01 17:43:47 (26369) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/01 17:43:47 (26369) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/01 17:43:47 (26369) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/01 17:45:46 (26375) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 17:48:48 (26386) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/01 17:48:48 (26386) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/01 17:48:48 (26386) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/01 17:53:49 (26403) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/01 17:53:49 (26403) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/01 17:53:49 (26403) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/01 17:55:02 (26411) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 17:58:50 (26421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/01 17:58:50 (26421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/01 17:58:50 (26421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/01 17:59:49 (26433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:00:16 (26503) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:03:51 (26545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/01 18:03:51 (26545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/01 18:03:51 (26545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/01 18:04:50 (26574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:08:53 (26648) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/01 18:08:53 (26648) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/01 18:08:53 (26648) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/01 18:13:54 (26690) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/01 18:13:54 (26690) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/01 18:13:54 (26690) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/01 18:14:11 (26694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:18:55 (26708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/01 18:18:55 (26708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/01 18:18:55 (26708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/01 18:23:16 (26728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:23:56 (26735) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/01 18:23:56 (26735) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/01 18:23:56 (26735) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/01 18:28:57 (26747) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/01 18:28:57 (26747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/01 18:28:57 (26747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/01 18:32:05 (26761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:32:42 (26788) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:33:37 (26810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:33:58 (26816) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/01 18:33:58 (26816) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/01 18:33:58 (26816) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/01 18:38:59 (26874) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/01 18:38:59 (26874) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/01 18:38:59 (26874) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/01 18:42:40 (26953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:44:00 (26960) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/01 18:44:00 (26960) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/01 18:44:00 (26960) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/01 18:49:01 (26974) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/01 18:49:01 (26974) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/01 18:49:01 (26974) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/01 18:52:04 (26991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 18:54:02 (26999) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/01 18:54:02 (26999) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/01 18:54:02 (26999) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/01 18:59:03 (27010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/01 18:59:03 (27010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/01 18:59:03 (27010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/01 18:59:57 (27016) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:01:40 (27114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:01:46 (27120) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:04:04 (27146) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/01 19:04:04 (27146) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/01 19:04:04 (27146) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/01 19:09:05 (27208) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/01 19:09:05 (27208) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/01 19:09:05 (27208) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/01 19:12:08 (27259) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:14:06 (27289) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/01 19:14:06 (27289) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/01 19:14:06 (27289) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/01 19:19:07 (27304) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/01 19:19:07 (27304) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/01 19:19:07 (27304) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/01 19:22:36 (27323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:24:08 (27330) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/01 19:24:08 (27330) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/01 19:24:08 (27330) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/01 19:29:09 (27342) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/01 19:29:09 (27342) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/01 19:29:09 (27342) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/01 19:32:08 (27359) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:32:35 (27377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:33:22 (27400) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:34:10 (27407) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/01 19:34:10 (27407) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/01 19:34:10 (27407) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/01 19:39:11 (27471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/01 19:39:11 (27471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/01 19:39:11 (27471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/01 19:44:10 (27548) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:44:12 (27554) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/01 19:44:12 (27554) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/01 19:44:12 (27554) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/01 19:49:13 (27568) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/01 19:49:13 (27568) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/01 19:49:13 (27568) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/01 19:53:44 (27585) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 19:54:14 (27591) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/01 19:54:14 (27591) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/01 19:54:14 (27591) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/01 19:59:16 (27609) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/01 19:59:16 (27609) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/01 19:59:16 (27609) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/01 19:59:40 (27611) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:04:17 (27713) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/01 20:04:17 (27713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/01 20:04:17 (27713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/01 20:04:32 (27718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:04:40 (27737) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:09:18 (27804) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/01 20:09:18 (27804) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/01 20:09:18 (27804) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/01 20:14:19 (27852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/01 20:14:19 (27852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/01 20:14:19 (27852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/01 20:15:36 (27883) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:19:20 (27901) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/01 20:19:20 (27901) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/01 20:19:20 (27901) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/01 20:24:21 (27911) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/01 20:24:21 (27911) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/01 20:24:21 (27911) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/01 20:25:21 (27916) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:28:19 (27935) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:29:22 (27955) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/01 20:29:22 (27955) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/01 20:29:22 (27955) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/01 20:34:23 (27965) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/01 20:34:23 (27965) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/01 20:34:23 (27965) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/01 20:34:56 (27973) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:37:13 (28034) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:39:24 (28075) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/01 20:39:24 (28075) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/01 20:39:24 (28075) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/01 20:44:01 (28095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:44:25 (28101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/01 20:44:25 (28101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/01 20:44:25 (28101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/01 20:49:26 (28174) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/01 20:49:26 (28174) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/01 20:49:26 (28174) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/01 20:54:27 (28189) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/01 20:54:27 (28189) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/01 20:54:27 (28189) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/01 20:54:55 (28194) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:56:16 (28205) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 20:59:28 (28230) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/01 20:59:28 (28230) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/01 20:59:28 (28230) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/01 21:04:29 (28315) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/01 21:04:29 (28315) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/01 21:04:29 (28315) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/01 21:05:14 (28324) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:09:08 (28377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:09:30 (28406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/01 21:09:30 (28406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/01 21:09:30 (28406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/01 21:14:31 (28421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/01 21:14:31 (28421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/01 21:14:31 (28421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/01 21:16:04 (28469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:19:32 (28507) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/01 21:19:32 (28507) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/01 21:19:32 (28507) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/01 21:24:33 (28520) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/01 21:24:33 (28520) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/01 21:24:33 (28520) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/01 21:26:30 (28532) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:26:35 (28539) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:29:34 (28558) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/01 21:29:34 (28558) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/01 21:29:34 (28558) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/01 21:34:35 (28573) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/01 21:34:35 (28573) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/01 21:34:35 (28573) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/01 21:35:49 (28583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:39:36 (28631) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/01 21:39:36 (28631) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/01 21:39:36 (28631) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/01 21:41:08 (28657) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:44:38 (28680) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/01 21:44:38 (28680) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/01 21:44:38 (28680) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/01 21:45:55 (28692) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:49:39 (28766) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/01 21:49:39 (28766) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/01 21:49:39 (28766) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/01 21:54:20 (28785) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:54:40 (28802) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/01 21:54:40 (28802) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/01 21:54:40 (28802) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/01 21:55:51 (28810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 21:59:41 (28820) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/01 21:59:41 (28820) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/01 21:59:41 (28820) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/01 22:04:42 (28908) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/01 22:04:42 (28908) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/01 22:04:42 (28908) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/01 22:05:07 (28912) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:09:43 (28967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/01 22:09:43 (28967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/01 22:09:43 (28967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/01 22:13:14 (28998) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:14:20 (29018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:14:44 (29028) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/01 22:14:44 (29028) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/01 22:14:44 (29028) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/01 22:19:45 (29101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/01 22:19:45 (29101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/01 22:19:45 (29101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/01 22:24:46 (29122) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/01 22:24:46 (29122) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/01 22:24:46 (29122) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/01 22:24:49 (29123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:25:20 (29133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:29:47 (29154) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/01 22:29:47 (29154) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/01 22:29:47 (29154) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/01 22:34:37 (29175) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:34:48 (29181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/01 22:34:48 (29181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/01 22:34:48 (29181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/01 22:39:49 (29222) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/01 22:39:49 (29222) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/01 22:39:49 (29222) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/01 22:44:32 (29267) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:44:43 (29287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:44:50 (29293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/01 22:44:50 (29293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/01 22:44:50 (29293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/01 22:49:51 (29343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/01 22:49:51 (29343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/01 22:49:51 (29343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/01 22:54:44 (29385) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:54:45 (29401) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 22:54:52 (29407) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/01 22:54:52 (29407) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/01 22:54:52 (29407) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/01 22:59:53 (29467) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/01 22:59:53 (29467) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/01 22:59:53 (29467) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/01 23:04:20 (29550) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:04:54 (29557) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/01 23:04:54 (29557) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/01 23:04:54 (29557) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/01 23:09:55 (29608) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/01 23:09:55 (29608) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/01 23:09:55 (29608) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/01 23:12:12 (29632) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:14:03 (29664) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:14:56 (29671) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/01 23:14:56 (29671) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/01 23:14:56 (29671) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/01 23:19:58 (29689) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/01 23:19:58 (29689) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/01 23:19:58 (29689) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/01 23:24:35 (29761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:24:58 (29798) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/01 23:24:58 (29798) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/01 23:24:58 (29798) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/01 23:25:38 (29833) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:29:59 (29867) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/01 23:29:59 (29867) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/01 23:29:59 (29867) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/01 23:35:00 (29888) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/01 23:35:00 (29888) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/01 23:35:00 (29888) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/01 23:35:06 (29889) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:40:01 (29942) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/01 23:40:01 (29942) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/01 23:40:01 (29942) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/01 23:40:09 (29947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:45:02 (29990) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/01 23:45:02 (29990) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/01 23:45:02 (29990) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/01 23:45:51 (29998) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:50:03 (30020) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/01 23:50:03 (30020) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/01 23:50:03 (30020) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/01 23:55:04 (30106) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/01 23:55:04 (30107) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/01 23:55:04 (30107) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/01 23:55:04 (30107) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/01 23:55:09 (30123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:00:05 (30193) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/02 00:00:05 (30193) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/02 00:00:05 (30193) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/02 00:05:06 (30222) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/02 00:05:06 (30222) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/02 00:05:06 (30222) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/02 00:05:57 (30230) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:10:07 (30294) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/02 00:10:07 (30294) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/02 00:10:07 (30294) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/02 00:10:55 (30310) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:15:08 (30335) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/02 00:15:08 (30335) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/02 00:15:08 (30335) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/02 00:15:31 (30339) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:20:09 (30362) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/02 00:20:09 (30362) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/02 00:20:09 (30362) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/02 00:24:46 (30431) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:25:10 (30437) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/02 00:25:10 (30437) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/02 00:25:10 (30437) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/02 00:26:00 (30446) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:30:11 (30478) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/02 00:30:11 (30478) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/02 00:30:11 (30478) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/02 00:34:07 (30486) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:35:12 (30496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/02 00:35:12 (30496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/02 00:35:12 (30496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/02 00:40:13 (30547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/02 00:40:13 (30547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/02 00:40:13 (30547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/02 00:40:42 (30565) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:43:42 (30591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:45:14 (30606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/02 00:45:14 (30606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/02 00:45:14 (30606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/02 00:50:15 (30622) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/02 00:50:15 (30622) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/02 00:50:15 (30622) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/02 00:53:28 (30636) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:54:25 (30685) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 00:55:16 (30724) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/02 00:55:16 (30724) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/02 00:55:16 (30724) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/02 01:00:17 (30791) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/02 01:00:17 (30791) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/02 01:00:17 (30791) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/02 01:03:45 (30823) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:05:24 (30891) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/02 01:05:24 (30891) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/02 01:05:24 (30891) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/02 01:05:56 (30959) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:08:17 (31015) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:09:10 (31037) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:10:25 (31067) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/02 01:10:25 (31067) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/02 01:10:25 (31067) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/02 01:15:13 (31092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:15:26 (31101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/02 01:15:26 (31101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/02 01:15:26 (31101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/02 01:20:27 (31117) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/02 01:20:27 (31117) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/02 01:20:27 (31117) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/02 01:24:15 (31131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:25:28 (31175) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/02 01:25:28 (31175) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/02 01:25:28 (31175) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/02 01:30:29 (31210) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/02 01:30:29 (31210) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/02 01:30:29 (31210) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/02 01:34:28 (31218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:35:26 (31231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:35:30 (31247) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/02 01:35:30 (31247) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/02 01:35:30 (31247) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/02 01:40:31 (31309) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/02 01:40:31 (31309) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/02 01:40:31 (31309) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/02 01:41:22 (31328) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:43:31 (31349) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:45:32 (31360) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/02 01:45:32 (31360) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/02 01:45:32 (31360) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/02 01:50:33 (31376) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/02 01:50:33 (31376) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/02 01:50:33 (31376) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/02 01:54:01 (31384) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 01:55:34 (31397) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/02 01:55:34 (31397) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/02 01:55:34 (31397) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/02 02:00:35 (31525) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/02 02:00:35 (31525) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/02 02:00:35 (31525) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/02 02:04:16 (31559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:05:36 (31574) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/02 02:05:36 (31574) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/02 02:05:36 (31574) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/02 02:06:58 (31586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:10:37 (31649) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/02 02:10:37 (31649) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/02 02:10:37 (31649) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/02 02:14:08 (31673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:14:20 (31692) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:15:38 (31702) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/02 02:15:38 (31702) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/02 02:15:38 (31702) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/02 02:20:39 (31721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/02 02:20:39 (31721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/02 02:20:39 (31721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/02 02:23:55 (31731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:25:40 (31738) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/02 02:25:40 (31738) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/02 02:25:40 (31738) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/02 02:30:42 (31875) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/02 02:30:42 (31875) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/02 02:30:42 (31875) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/02 02:33:22 (31882) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:35:42 (31902) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/02 02:35:42 (31902) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/02 02:35:42 (31902) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/02 02:36:24 (31905) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:40:43 (31971) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/02 02:40:43 (31971) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/02 02:40:43 (31971) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/02 02:43:11 (31991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:45:09 (32007) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:45:44 (32023) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/02 02:45:44 (32023) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/02 02:45:44 (32023) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/02 02:50:45 (32039) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/02 02:50:45 (32039) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/02 02:50:45 (32039) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/02 02:53:18 (32046) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 02:55:46 (32059) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/02 02:55:46 (32059) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/02 02:55:46 (32059) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/02 03:00:47 (32181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/02 03:00:47 (32181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/02 03:00:47 (32181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/02 03:02:29 (32208) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:05:48 (32239) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/02 03:05:48 (32239) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/02 03:05:48 (32239) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/02 03:05:57 (32241) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:10:49 (32315) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/02 03:10:49 (32315) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/02 03:10:49 (32315) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/02 03:12:55 (32335) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:15:50 (32349) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/02 03:15:50 (32349) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/02 03:15:50 (32349) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/02 03:16:31 (32355) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:20:51 (32389) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/02 03:20:51 (32389) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/02 03:20:51 (32389) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/02 03:23:07 (32396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:25:52 (32411) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/02 03:25:52 (32411) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/02 03:25:52 (32411) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/02 03:30:53 (32462) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/02 03:30:53 (32462) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/02 03:30:53 (32462) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/02 03:33:22 (32490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:35:54 (32511) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/02 03:35:54 (32511) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/02 03:35:54 (32511) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/02 03:37:51 (32520) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:40:55 (32592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/02 03:40:55 (32592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/02 03:40:55 (32592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/02 03:43:29 (32611) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:44:56 (32625) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:45:56 (32645) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/02 03:45:56 (32645) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/02 03:45:56 (32645) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/02 03:50:57 (32662) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/02 03:50:57 (32662) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/02 03:50:57 (32662) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/02 03:52:43 (32667) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 03:55:58 (32683) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/02 03:55:58 (32683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/02 03:55:58 (32683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/02 04:00:59 (32748) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/02 04:00:59 (32748) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/02 04:00:59 (32748) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/02 04:01:54 (345) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:06:00 (396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/02 04:06:00 (396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/02 04:06:00 (396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/02 04:07:10 (405) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:11:01 (467) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/02 04:11:02 (467) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/02 04:11:02 (467) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/02 04:12:54 (489) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:14:27 (502) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:16:02 (525) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/02 04:16:02 (525) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/02 04:16:02 (525) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/02 04:21:03 (541) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/02 04:21:03 (541) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/02 04:21:03 (541) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/02 04:21:58 (546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:26:05 (565) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/02 04:26:05 (565) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/02 04:26:05 (565) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/02 04:31:04 (578) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:31:05 (584) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/02 04:31:05 (584) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/02 04:31:05 (584) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/02 04:36:06 (666) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/02 04:36:06 (666) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/02 04:36:06 (666) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/02 04:37:23 (1130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:40:38 (1188) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:41:07 (1204) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/02 04:41:07 (1204) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/02 04:41:07 (1204) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/02 04:42:55 (1223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:46:08 (1261) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/02 04:46:08 (1261) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/02 04:46:08 (1261) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/02 04:51:09 (1274) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/02 04:51:09 (1274) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/02 04:51:09 (1274) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/02 04:51:35 (1278) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 04:56:10 (1296) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/02 04:56:10 (1296) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/02 04:56:10 (1296) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/02 05:01:11 (1421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/02 05:01:11 (1421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/02 05:01:11 (1421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/02 05:01:18 (1422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:06:12 (1531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/02 05:06:12 (1531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/02 05:06:12 (1531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/02 05:09:37 (1567) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:10:15 (1592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:10:49 (1614) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:11:13 (1626) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/02 05:11:13 (1626) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/02 05:11:13 (1626) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/02 05:16:14 (1662) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/02 05:16:14 (1662) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/02 05:16:14 (1662) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/02 05:21:15 (1681) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/02 05:21:15 (1681) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/02 05:21:15 (1681) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/02 05:21:25 (1682) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:26:16 (1703) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/02 05:26:16 (1703) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/02 05:26:16 (1703) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/02 05:30:22 (1715) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:31:17 (1723) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/02 05:31:17 (1723) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/02 05:31:17 (1723) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/02 05:36:18 (1806) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/02 05:36:18 (1806) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/02 05:36:18 (1806) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/02 05:39:15 (1848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:40:13 (1876) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:40:21 (1892) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:41:19 (1919) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/02 05:41:19 (1919) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/02 05:41:19 (1919) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/02 05:46:20 (1947) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/02 05:46:20 (1947) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/02 05:46:20 (1947) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/02 05:50:32 (1963) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 05:51:21 (1970) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/02 05:51:21 (1970) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/02 05:51:21 (1970) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/02 05:56:22 (1984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/02 05:56:22 (1984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/02 05:56:22 (1984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/02 06:00:08 (2083) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:01:23 (2111) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/02 06:01:23 (2111) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/02 06:01:23 (2111) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/02 06:06:25 (2185) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/02 06:06:25 (2185) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/02 06:06:25 (2185) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/02 06:07:30 (2213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:09:13 (2271) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:10:39 (2286) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:11:26 (2310) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/02 06:11:26 (2310) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/02 06:11:26 (2310) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/02 06:16:27 (2348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/02 06:16:27 (2348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/02 06:16:27 (2348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/02 06:20:10 (2367) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:21:28 (2374) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/02 06:21:28 (2374) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/02 06:21:28 (2374) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/02 06:26:29 (2389) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/02 06:26:29 (2389) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/02 06:26:29 (2389) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/02 06:29:17 (2397) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:31:30 (2413) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/02 06:31:30 (2413) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/02 06:31:30 (2413) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/02 06:35:25 (2429) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:36:31 (2452) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/02 06:36:31 (2452) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/02 06:36:31 (2452) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/02 06:40:09 (2541) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:41:32 (2551) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/02 06:41:32 (2551) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/02 06:41:32 (2551) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/02 06:42:39 (2575) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:46:33 (2602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/02 06:46:33 (2602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/02 06:46:33 (2602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/02 06:50:32 (2616) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 06:51:34 (2623) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/02 06:51:34 (2623) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/02 06:51:34 (2623) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/02 06:56:35 (2633) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/02 06:56:35 (2633) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/02 06:56:35 (2633) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/02 07:01:29 (2802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:01:36 (2811) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/02 07:01:36 (2811) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/02 07:01:36 (2811) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/02 07:06:37 (2830) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/02 07:06:37 (2830) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/02 07:06:37 (2830) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/02 07:07:14 (2842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:11:24 (2953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:11:38 (2965) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/02 07:11:38 (2965) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/02 07:11:38 (2965) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/02 07:13:49 (2990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:16:39 (3017) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/02 07:16:39 (3017) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/02 07:16:39 (3017) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/02 07:21:40 (3030) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/02 07:21:40 (3030) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/02 07:21:40 (3030) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/02 07:21:51 (3034) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:26:41 (3110) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/02 07:26:41 (3110) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/02 07:26:41 (3110) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/02 07:30:51 (3136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:31:42 (3145) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/02 07:31:42 (3145) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/02 07:31:42 (3145) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/02 07:35:57 (3160) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:36:43 (3177) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/02 07:36:43 (3177) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/02 07:36:43 (3177) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/02 07:41:06 (3280) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:41:30 (3287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:41:44 (3305) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/02 07:41:44 (3305) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/02 07:41:44 (3305) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/02 07:46:45 (3338) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/02 07:46:45 (3338) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/02 07:46:45 (3338) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/02 07:51:46 (3354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/02 07:51:46 (3354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/02 07:51:46 (3354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/02 07:51:52 (3355) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 07:56:48 (3375) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/02 07:56:48 (3375) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/02 07:56:48 (3375) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/02 08:01:37 (3497) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:01:48 (3503) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/02 08:01:48 (3503) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/02 08:01:48 (3503) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/02 08:06:49 (3517) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/02 08:06:49 (3517) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/02 08:06:49 (3517) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/02 08:08:28 (3525) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:09:03 (3545) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:10:54 (3631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:11:50 (3662) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/02 08:11:50 (3662) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/02 08:11:50 (3662) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/02 08:16:51 (3694) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/02 08:16:51 (3694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/02 08:16:51 (3694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/02 08:20:00 (3701) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:21:52 (3715) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/02 08:21:52 (3715) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/02 08:21:52 (3715) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/02 08:26:53 (3728) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/02 08:26:53 (3728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/02 08:26:53 (3728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/02 08:30:14 (3744) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:31:54 (3754) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/02 08:31:54 (3754) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/02 08:31:54 (3754) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/02 08:36:55 (3768) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/02 08:36:55 (3768) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/02 08:36:55 (3768) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/02 08:39:58 (3803) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:40:12 (3828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:40:31 (3834) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:41:56 (3891) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/02 08:41:56 (3891) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/02 08:41:56 (3891) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/02 08:46:57 (3950) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/02 08:46:57 (3950) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/02 08:46:57 (3950) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/02 08:49:36 (3957) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 08:51:58 (3972) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/02 08:51:58 (3972) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/02 08:51:58 (3972) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/02 08:56:59 (3987) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/02 08:56:59 (3987) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/02 08:56:59 (3987) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/02 09:00:22 (4089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:02:00 (4116) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/02 09:02:00 (4116) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/02 09:02:00 (4116) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/02 09:07:01 (4126) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/02 09:07:01 (4126) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/02 09:07:01 (4126) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/02 09:08:33 (4139) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:10:33 (4196) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:10:44 (4213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:12:02 (4226) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/02 09:12:02 (4226) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/02 09:12:02 (4226) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/02 09:17:03 (4319) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/02 09:17:03 (4319) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/02 09:17:03 (4319) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/02 09:20:43 (4331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:22:04 (4341) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/02 09:22:04 (4341) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/02 09:22:04 (4341) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/02 09:27:05 (4359) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/02 09:27:05 (4359) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/02 09:27:05 (4359) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/02 09:30:37 (4371) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:32:06 (4380) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/02 09:32:06 (4380) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/02 09:32:06 (4380) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/02 09:37:07 (4397) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/02 09:37:07 (4397) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/02 09:37:07 (4397) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/02 09:37:35 (4400) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:39:02 (4424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:40:46 (4477) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:42:08 (4487) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/02 09:42:08 (4487) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/02 09:42:08 (4487) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/02 09:47:10 (4575) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/02 09:47:10 (4575) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/02 09:47:10 (4575) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/02 09:50:05 (4587) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 09:52:10 (4598) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/02 09:52:10 (4598) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/02 09:52:10 (4598) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/02 09:57:11 (4616) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/02 09:57:11 (4616) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/02 09:57:11 (4616) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/02 09:59:24 (4627) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:02:12 (4743) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/02 10:02:12 (4743) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/02 10:02:12 (4743) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/02 10:07:13 (4757) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/02 10:07:13 (4757) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/02 10:07:13 (4757) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/02 10:10:09 (4810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:10:14 (4828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:10:35 (4834) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:12:14 (4852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/02 10:12:14 (4852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/02 10:12:14 (4852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/02 10:17:15 (4946) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/02 10:17:15 (4946) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/02 10:17:15 (4946) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/02 10:20:49 (4959) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:22:16 (4967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/02 10:22:16 (4967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/02 10:22:16 (4967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/02 10:27:17 (4986) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/02 10:27:17 (4986) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/02 10:27:17 (4986) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/02 10:30:45 (5000) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:32:18 (5008) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/02 10:32:18 (5008) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/02 10:32:18 (5008) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/02 10:37:19 (5029) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/02 10:37:19 (5029) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/02 10:37:19 (5029) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/02 10:37:47 (5031) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:41:46 (5088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:42:14 (5095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:42:20 (5112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/02 10:42:20 (5112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/02 10:42:20 (5112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/02 10:47:21 (5205) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/02 10:47:21 (5205) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/02 10:47:21 (5205) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/02 10:52:22 (5224) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/02 10:52:22 (5224) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/02 10:52:22 (5224) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/02 10:52:28 (5225) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 10:57:23 (5242) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/02 10:57:23 (5242) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/02 10:57:23 (5242) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/02 11:02:24 (5359) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/02 11:02:24 (5359) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/02 11:02:24 (5359) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/02 11:02:47 (5363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:05:26 (5391) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:07:25 (5411) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/02 11:07:25 (5411) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/02 11:07:25 (5411) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/02 11:12:26 (5451) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/02 11:12:26 (5451) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/02 11:12:26 (5451) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/02 11:12:42 (5452) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:13:10 (5479) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:17:27 (5515) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/02 11:17:27 (5515) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/02 11:17:27 (5515) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/02 11:22:28 (5587) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/02 11:22:28 (5587) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/02 11:22:28 (5587) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/02 11:24:07 (5592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:27:29 (5609) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/02 11:27:29 (5609) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/02 11:27:29 (5609) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/02 11:32:30 (5630) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/02 11:32:30 (5630) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/02 11:32:30 (5630) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/02 11:34:15 (5638) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:34:39 (5649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:37:31 (5673) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/02 11:37:31 (5673) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/02 11:37:31 (5673) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/02 11:41:10 (5712) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:42:33 (5730) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/02 11:42:33 (5730) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/02 11:42:33 (5730) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/02 11:44:08 (5745) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:47:33 (5771) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/02 11:47:33 (5771) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/02 11:47:33 (5771) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/02 11:52:34 (5847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/02 11:52:34 (5847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/02 11:52:34 (5847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/02 11:54:17 (5854) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 11:57:35 (5867) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/02 11:57:35 (5867) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/02 11:57:35 (5867) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/02 12:02:09 (6000) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:02:36 (6017) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/02 12:02:36 (6017) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/02 12:02:36 (6017) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/02 12:04:41 (6023) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:07:37 (6036) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/02 12:07:37 (6036) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/02 12:07:37 (6036) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/02 12:12:35 (6080) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:12:38 (6096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/02 12:12:38 (6096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/02 12:12:38 (6096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/02 12:15:16 (6123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:17:39 (6135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/02 12:17:39 (6135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/02 12:17:39 (6135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/02 12:22:40 (6218) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/02 12:22:40 (6218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/02 12:22:40 (6218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/02 12:24:48 (6224) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:27:41 (6236) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/02 12:27:41 (6236) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/02 12:27:41 (6236) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/02 12:29:32 (6246) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:32:42 (6296) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/02 12:32:42 (6296) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/02 12:32:42 (6296) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/02 12:35:27 (6303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:37:43 (6320) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/02 12:37:43 (6320) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/02 12:37:43 (6320) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/02 12:40:37 (6380) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:42:44 (6425) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/02 12:42:44 (6425) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/02 12:42:44 (6425) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/02 12:45:38 (6453) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:47:45 (6466) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/02 12:47:45 (6466) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/02 12:47:45 (6466) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/02 12:52:46 (6539) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/02 12:52:46 (6539) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/02 12:52:46 (6539) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/02 12:54:54 (6549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 12:57:47 (6572) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/02 12:57:47 (6572) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/02 12:57:47 (6572) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/02 13:01:17 (6695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:02:48 (6713) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/02 13:02:48 (6713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/02 13:02:48 (6713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/02 13:04:24 (6719) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:07:49 (6737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/02 13:07:49 (6737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/02 13:07:49 (6737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/02 13:10:40 (6749) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:12:50 (6794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/02 13:12:50 (6794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/02 13:12:50 (6794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/02 13:14:16 (6807) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:17:51 (6836) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/02 13:17:51 (6836) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/02 13:17:51 (6836) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/02 13:22:52 (6893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/02 13:22:52 (6893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/02 13:22:52 (6893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/02 13:24:43 (6921) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:27:53 (6930) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/02 13:27:53 (6930) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/02 13:27:53 (6930) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/02 13:32:54 (6940) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/02 13:32:54 (6940) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/02 13:32:54 (6940) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/02 13:33:55 (6946) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:34:17 (6965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:37:55 (6978) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/02 13:37:55 (6978) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/02 13:37:55 (6978) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/02 13:42:49 (7022) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:42:57 (7038) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/02 13:42:57 (7038) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/02 13:42:57 (7038) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/02 13:44:35 (7052) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:47:57 (7077) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/02 13:47:57 (7077) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/02 13:47:57 (7077) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/02 13:52:58 (7104) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/02 13:52:58 (7104) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/02 13:52:58 (7104) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/02 13:54:21 (7147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 13:57:59 (7191) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/02 13:57:59 (7191) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/02 13:57:59 (7191) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/02 14:03:00 (7308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/02 14:03:00 (7308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/02 14:03:00 (7308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/02 14:04:36 (7316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:05:47 (7327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:08:01 (7348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/02 14:08:01 (7348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/02 14:08:01 (7348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/02 14:13:02 (7389) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/02 14:13:02 (7389) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/02 14:13:02 (7389) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/02 14:13:44 (7395) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:14:10 (7422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:18:03 (7452) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/02 14:18:03 (7452) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/02 14:18:03 (7452) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/02 14:23:04 (7472) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/02 14:23:04 (7472) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/02 14:23:04 (7472) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/02 14:23:23 (7476) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:28:05 (7550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/02 14:28:05 (7550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/02 14:28:05 (7550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/02 14:33:06 (7570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/02 14:33:06 (7570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/02 14:33:06 (7570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/02 14:33:22 (7574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:35:26 (7589) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:38:07 (7610) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/02 14:38:07 (7610) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/02 14:38:07 (7610) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/02 14:43:08 (7650) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/02 14:43:08 (7650) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/02 14:43:08 (7650) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/02 14:44:13 (7662) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:44:20 (7683) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:48:09 (7710) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/02 14:48:09 (7710) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/02 14:48:09 (7710) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/02 14:53:10 (7736) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/02 14:53:10 (7736) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/02 14:53:10 (7736) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/02 14:53:22 (7744) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 14:58:11 (7925) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/02 14:58:11 (7925) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/02 14:58:11 (7925) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/02 15:02:25 (8088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:03:12 (8097) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/02 15:03:12 (8097) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/02 15:03:12 (8097) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/02 15:07:24 (8109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:08:13 (8129) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/02 15:08:13 (8129) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/02 15:08:13 (8129) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/02 15:13:14 (8169) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:13:15 (8175) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/02 15:13:15 (8175) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/02 15:13:15 (8175) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/02 15:16:30 (8208) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:18:16 (8235) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/02 15:18:16 (8235) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/02 15:18:16 (8235) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/02 15:23:17 (8248) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/02 15:23:17 (8248) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/02 15:23:17 (8248) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/02 15:23:44 (8253) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:28:19 (8379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/02 15:28:19 (8379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/02 15:28:19 (8379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/02 15:33:12 (8411) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:33:20 (8417) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/02 15:33:20 (8417) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/02 15:33:20 (8417) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/02 15:34:35 (8424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:38:21 (8449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/02 15:38:21 (8449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/02 15:38:21 (8449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/02 15:43:22 (8487) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/02 15:43:22 (8487) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/02 15:43:22 (8487) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/02 15:43:35 (8492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:43:58 (8511) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:48:23 (8552) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/02 15:48:23 (8552) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/02 15:48:23 (8552) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/02 15:53:24 (8566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/02 15:53:24 (8566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/02 15:53:24 (8566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/02 15:54:32 (8582) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 15:58:25 (8636) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/02 15:58:25 (8636) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/02 15:58:25 (8636) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/02 16:03:26 (8772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/02 16:03:26 (8772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/02 16:03:26 (8772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/02 16:04:48 (8784) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:07:03 (8796) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:08:27 (8816) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/02 16:08:27 (8816) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/02 16:08:27 (8816) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/02 16:13:28 (8853) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/02 16:13:28 (8853) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/02 16:13:28 (8853) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/02 16:14:15 (8862) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:14:25 (8871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:18:29 (8920) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/02 16:18:29 (8920) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/02 16:18:29 (8920) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/02 16:23:30 (8933) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/02 16:23:30 (8933) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/02 16:23:30 (8933) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/02 16:23:34 (8935) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:28:31 (8961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/02 16:28:31 (8961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/02 16:28:31 (8961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/02 16:33:32 (9040) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/02 16:33:32 (9040) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/02 16:33:32 (9040) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/02 16:33:36 (9043) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:33:56 (9049) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:38:33 (9075) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/02 16:38:33 (9075) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/02 16:38:33 (9075) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/02 16:43:34 (9113) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/02 16:43:34 (9113) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/02 16:43:34 (9113) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/02 16:44:16 (9120) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:44:46 (9134) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:48:35 (9179) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/02 16:48:35 (9179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/02 16:48:35 (9179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/02 16:53:36 (9192) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/02 16:53:36 (9192) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/02 16:53:36 (9192) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/02 16:54:19 (9203) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 16:58:37 (9232) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/02 16:58:37 (9232) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/02 16:58:37 (9232) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/02 17:03:38 (9413) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/02 17:03:38 (9413) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/02 17:03:38 (9413) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/02 17:03:43 (9414) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:03:59 (9420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:08:39 (9450) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/02 17:08:39 (9450) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/02 17:08:39 (9450) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/02 17:13:40 (9487) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/02 17:13:40 (9487) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/02 17:13:40 (9487) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/02 17:13:48 (9488) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:16:59 (9532) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:18:41 (9553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/02 17:18:41 (9553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/02 17:18:41 (9553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/02 17:23:32 (9565) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:23:42 (9572) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/02 17:23:42 (9572) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/02 17:23:42 (9572) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/02 17:28:43 (9592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/02 17:28:43 (9592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/02 17:28:43 (9592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/02 17:31:38 (9647) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:33:44 (9688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/02 17:33:44 (9688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/02 17:33:44 (9688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/02 17:34:20 (9692) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:38:45 (9709) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/02 17:38:45 (9709) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/02 17:38:45 (9709) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/02 17:43:24 (9748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:43:46 (9755) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/02 17:43:46 (9755) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/02 17:43:46 (9755) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/02 17:45:42 (9774) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:48:47 (9812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/02 17:48:47 (9812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/02 17:48:47 (9812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/02 17:52:58 (9833) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 17:53:48 (9844) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/02 17:53:48 (9844) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/02 17:53:48 (9844) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/02 17:58:49 (9862) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/02 17:58:49 (9862) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/02 17:58:49 (9862) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/02 17:59:50 (9868) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:03:44 (10037) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:03:50 (10045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/02 18:03:50 (10045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/02 18:03:50 (10045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/02 18:08:51 (10079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/02 18:08:51 (10079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/02 18:08:51 (10079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/02 18:12:51 (10118) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:13:52 (10125) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/02 18:13:52 (10125) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/02 18:13:52 (10125) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/02 18:17:07 (10164) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:18:53 (10185) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/02 18:18:53 (10185) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/02 18:18:53 (10185) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/02 18:22:08 (10207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:23:54 (10215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:23:55 (10215) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 18:23:55 (10215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 18:23:55 (10215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 18:27:47 (10234) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:28:55 (10251) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/02 18:28:55 (10251) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/02 18:28:55 (10251) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/02 18:31:20 (10264) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:33:56 (10311) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:33:57 (10311) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 18:33:57 (10311) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 18:33:57 (10311) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 18:33:58 (10314) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/02 18:33:58 (10314) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/02 18:33:58 (10314) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/02 18:38:58 (10349) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:38:59 (10349) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 18:38:59 (10349) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 18:38:59 (10349) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 18:42:18 (10365) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:43:59 (10397) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/02 18:43:59 (10397) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/02 18:43:59 (10397) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/02 18:49:00 (10441) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/02 18:49:00 (10441) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/02 18:49:00 (10441) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/02 18:49:01 (10442) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:52:28 (10476) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 18:54:02 (10488) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/02 18:54:02 (10488) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/02 18:54:02 (10488) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/02 18:59:02 (10500) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/02 18:59:02 (10500) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/02 18:59:02 (10500) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/02 19:00:14 (10596) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:01:48 (10637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:04:03 (10645) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/02 19:04:03 (10645) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/02 19:04:03 (10645) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/02 19:09:04 (10722) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:09:04 (10722) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 19:09:04 (10722) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 19:09:04 (10722) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 19:11:46 (10738) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:14:05 (10774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/02 19:14:05 (10774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/02 19:14:05 (10774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/02 19:19:06 (10814) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:19:06 (10814) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 19:19:06 (10814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 19:19:06 (10814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 19:20:49 (10827) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:22:18 (10850) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:24:07 (10858) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/02 19:24:07 (10858) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/02 19:24:07 (10858) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/02 19:29:08 (10876) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:29:08 (10876) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 19:29:08 (10876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 19:29:08 (10876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 19:31:35 (10888) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:32:13 (10902) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:34:09 (10920) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/02 19:34:09 (10920) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/02 19:34:09 (10920) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/02 19:39:10 (10993) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:39:10 (10993) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 19:39:10 (10993) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 19:39:10 (10993) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 19:40:46 (11005) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:44:11 (11045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/02 19:44:11 (11045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/02 19:44:11 (11045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/02 19:48:34 (11082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:49:12 (11099) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/02 19:49:12 (11099) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/02 19:49:12 (11099) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/02 19:50:48 (11113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 19:54:13 (11127) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/02 19:54:13 (11127) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/02 19:54:13 (11127) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/02 19:59:14 (11145) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/02 19:59:14 (11145) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/02 19:59:14 (11145) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/02 20:00:59 (11239) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:02:07 (11267) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:04:15 (11288) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/02 20:04:15 (11288) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/02 20:04:15 (11288) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/02 20:09:16 (11363) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/02 20:09:16 (11363) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/02 20:09:16 (11363) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/02 20:10:27 (11378) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:14:17 (11415) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/02 20:14:17 (11415) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/02 20:14:17 (11415) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/02 20:15:38 (11424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:19:18 (11474) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/02 20:19:18 (11474) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/02 20:19:18 (11474) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/02 20:20:20 (11483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:24:19 (11496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/02 20:24:19 (11496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/02 20:24:19 (11496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/02 20:29:20 (11514) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:29:21 (11514) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 20:29:21 (11514) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 20:29:21 (11514) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 20:30:59 (11526) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:33:15 (11538) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:34:21 (11555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/02 20:34:21 (11555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/02 20:34:21 (11555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/02 20:39:22 (11608) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:39:23 (11608) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 20:39:23 (11608) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 20:39:23 (11608) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 20:41:28 (11647) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:44:24 (11680) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/02 20:44:24 (11680) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/02 20:44:24 (11680) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/02 20:45:55 (11695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:49:24 (11742) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/02 20:49:24 (11742) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/02 20:49:24 (11742) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/02 20:50:40 (11751) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 20:54:25 (11761) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/02 20:54:25 (11761) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/02 20:54:25 (11761) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/02 20:59:26 (11780) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/02 20:59:26 (11780) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/02 20:59:26 (11780) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/02 21:00:49 (11874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:04:27 (11902) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/02 21:04:27 (11902) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/02 21:04:27 (11902) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/02 21:05:48 (11915) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:09:28 (11948) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/02 21:09:28 (11948) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/02 21:09:28 (11948) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/02 21:11:39 (12011) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:14:13 (12056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:14:29 (12073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:14:29 (12073) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 21:14:29 (12073) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 21:14:29 (12073) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 21:19:30 (12114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/02 21:19:30 (12114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/02 21:19:30 (12114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/02 21:21:13 (12124) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:24:31 (12133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:24:31 (12133) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 21:24:31 (12133) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 21:24:31 (12133) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 21:29:32 (12151) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/02 21:29:32 (12151) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/02 21:29:32 (12151) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/02 21:31:57 (12166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:34:33 (12179) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:34:33 (12179) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 21:34:33 (12179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 21:34:33 (12179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 21:38:25 (12198) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:39:34 (12215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/02 21:39:34 (12215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/02 21:39:34 (12215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/02 21:41:15 (12266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:41:44 (12273) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:44:35 (12338) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/02 21:44:35 (12338) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/02 21:44:35 (12338) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/02 21:49:36 (12373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/02 21:49:36 (12373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/02 21:49:36 (12373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/02 21:50:21 (12382) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:54:37 (12395) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:54:37 (12395) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 21:54:37 (12395) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 21:54:37 (12395) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 21:59:29 (12412) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 21:59:38 (12418) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/02 21:59:38 (12418) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/02 21:59:38 (12418) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/02 22:04:39 (12542) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:04:39 (12542) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 22:04:39 (12542) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 22:04:39 (12542) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 22:08:39 (12563) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:09:15 (12583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:09:40 (12589) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/02 22:09:40 (12589) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/02 22:09:40 (12589) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/02 22:10:20 (12599) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:14:41 (12709) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:14:41 (12709) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 22:14:41 (12709) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 22:14:41 (12709) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 22:19:20 (12750) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:19:42 (12756) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/02 22:19:42 (12756) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/02 22:19:42 (12756) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/02 22:24:43 (12769) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/02 22:24:43 (12769) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/02 22:24:43 (12769) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/02 22:29:45 (12785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/02 22:29:45 (12785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/02 22:29:45 (12785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/02 22:30:04 (12794) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:34:45 (12812) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:34:45 (12812) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 22:34:45 (12812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 22:34:45 (12812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 22:38:17 (12830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:39:46 (12850) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/02 22:39:46 (12850) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/02 22:39:46 (12850) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/02 22:39:53 (12851) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:40:56 (12869) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:44:47 (12963) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:44:47 (12963) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 22:44:47 (12963) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 22:44:47 (12963) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 22:49:01 (13004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:49:48 (13010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/02 22:49:48 (13010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/02 22:49:48 (13010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/02 22:54:49 (13025) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:54:49 (13025) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 22:54:49 (13025) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 22:54:49 (13025) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 22:58:24 (13093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 22:59:50 (13100) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/02 22:59:50 (13100) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/02 22:59:50 (13100) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/02 23:04:51 (13218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:04:51 (13218) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 23:04:51 (13218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 23:04:51 (13218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 23:08:38 (13241) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:09:44 (13255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:09:52 (13272) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/02 23:09:52 (13272) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/02 23:09:52 (13272) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/02 23:10:11 (13278) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:14:53 (13367) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:14:53 (13367) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/02 23:14:53 (13367) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/02 23:14:53 (13367) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/02 23:18:34 (13426) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:19:54 (13433) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/02 23:19:54 (13433) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/02 23:19:54 (13433) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/02 23:24:55 (13446) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/02 23:24:55 (13446) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/02 23:24:55 (13446) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/02 23:29:21 (13516) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:29:56 (13531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/02 23:29:56 (13531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/02 23:29:56 (13531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/02 23:34:57 (13545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/02 23:34:57 (13545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/02 23:34:57 (13545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/02 23:38:48 (13561) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:39:58 (13586) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/02 23:39:58 (13586) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/02 23:39:58 (13586) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/02 23:40:09 (13594) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:40:18 (13610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:44:59 (13655) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/02 23:44:59 (13655) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/02 23:44:59 (13655) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/02 23:50:00 (13732) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/02 23:50:00 (13732) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/02 23:50:00 (13732) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/02 23:50:45 (13740) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/02 23:55:01 (13765) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/02 23:55:01 (13765) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/02 23:55:01 (13765) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/03 00:00:02 (13831) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/03 00:00:02 (13831) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/03 00:00:02 (13831) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/03 00:01:05 (13898) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:05:03 (13910) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/03 00:05:03 (13910) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/03 00:05:03 (13910) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/03 00:08:48 (13928) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:10:04 (13961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/03 00:10:04 (13961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/03 00:10:04 (13961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/03 00:10:15 (13966) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:10:36 (13975) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:15:05 (14020) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/03 00:15:05 (14020) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/03 00:15:05 (14020) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/03 00:19:57 (14114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:20:07 (14125) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/03 00:20:07 (14125) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/03 00:20:07 (14125) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/03 00:25:07 (14140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/03 00:25:07 (14140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/03 00:25:07 (14140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/03 00:29:31 (14152) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:30:08 (14163) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/03 00:30:08 (14163) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/03 00:30:08 (14163) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/03 00:35:09 (14177) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/03 00:35:09 (14177) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/03 00:35:09 (14177) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/03 00:37:56 (14187) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:38:43 (14207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:40:10 (14227) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/03 00:40:10 (14227) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/03 00:40:10 (14227) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/03 00:43:07 (14238) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:45:11 (14283) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/03 00:45:11 (14283) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/03 00:45:11 (14283) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/03 00:49:16 (14356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 00:50:12 (14391) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/03 00:50:12 (14391) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/03 00:50:12 (14391) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/03 00:55:13 (14404) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/03 00:55:13 (14404) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/03 00:55:13 (14404) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/03 01:00:08 (14513) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:00:14 (14519) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/03 01:00:14 (14519) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/03 01:00:14 (14519) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/03 01:05:24 (14618) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/03 01:05:24 (14618) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/03 01:05:24 (14618) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/03 01:05:54 (14725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:06:44 (14743) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:08:22 (14772) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:10:25 (14801) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/03 01:10:25 (14801) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/03 01:10:25 (14801) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/03 01:15:26 (14837) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/03 01:15:26 (14837) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/03 01:15:26 (14837) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/03 01:16:38 (14851) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:20:27 (14921) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/03 01:20:27 (14921) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/03 01:20:27 (14921) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/03 01:25:28 (14951) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/03 01:25:28 (14951) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/03 01:25:28 (14951) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/03 01:26:44 (14956) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:30:29 (14976) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/03 01:30:29 (14976) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/03 01:30:29 (14976) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/03 01:35:30 (14991) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/03 01:35:30 (14991) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/03 01:35:30 (14991) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/03 01:35:34 (14992) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:37:38 (15022) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:38:41 (15036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:40:31 (15060) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/03 01:40:31 (15060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/03 01:40:31 (15060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/03 01:45:32 (15095) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/03 01:45:32 (15095) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/03 01:45:32 (15095) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/03 01:48:32 (15113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 01:50:33 (15175) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/03 01:50:33 (15175) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/03 01:50:33 (15175) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/03 01:55:34 (15207) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/03 01:55:34 (15207) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/03 01:55:34 (15207) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/03 01:59:21 (15218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:00:35 (15321) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/03 02:00:35 (15321) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/03 02:00:35 (15321) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/03 02:05:36 (15359) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/03 02:05:36 (15359) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/03 02:05:36 (15359) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/03 02:05:52 (15360) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:10:10 (15407) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:10:37 (15413) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/03 02:10:37 (15413) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/03 02:10:37 (15413) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/03 02:11:07 (15419) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:15:38 (15467) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/03 02:15:38 (15467) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/03 02:15:38 (15467) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/03 02:20:35 (15514) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:20:40 (15520) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/03 02:20:40 (15520) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/03 02:20:40 (15520) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/03 02:25:40 (15584) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/03 02:25:40 (15584) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/03 02:25:40 (15584) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/03 02:29:48 (15602) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:30:41 (15672) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/03 02:30:41 (15672) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/03 02:30:41 (15672) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/03 02:33:29 (15680) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:35:42 (15700) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/03 02:35:42 (15700) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/03 02:35:42 (15700) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/03 02:39:20 (15725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:40:43 (15740) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/03 02:40:43 (15740) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/03 02:40:43 (15740) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/03 02:43:46 (15748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:45:44 (15790) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/03 02:45:44 (15790) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/03 02:45:44 (15790) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/03 02:49:26 (15828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 02:50:45 (15839) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/03 02:50:45 (15839) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/03 02:50:45 (15839) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/03 02:55:46 (15908) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/03 02:55:46 (15908) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/03 02:55:46 (15908) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/03 02:59:35 (15925) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:00:47 (16024) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/03 03:00:47 (16024) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/03 03:00:47 (16024) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/03 03:00:55 (16025) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:05:48 (16074) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/03 03:05:48 (16074) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/03 03:05:48 (16074) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/03 03:10:16 (16115) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:10:49 (16121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/03 03:10:49 (16121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/03 03:10:49 (16121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/03 03:12:51 (16132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:15:50 (16177) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/03 03:15:50 (16177) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/03 03:15:50 (16177) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/03 03:20:51 (16215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/03 03:20:51 (16215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/03 03:20:51 (16215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/03 03:21:17 (16220) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:25:52 (16297) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/03 03:25:52 (16297) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/03 03:25:52 (16297) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/03 03:30:31 (16313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:30:53 (16319) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/03 03:30:53 (16319) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/03 03:30:53 (16319) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/03 03:32:58 (16328) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:35:54 (16353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/03 03:35:54 (16353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/03 03:35:54 (16353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/03 03:39:56 (16374) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:40:55 (16385) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/03 03:40:55 (16385) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/03 03:40:55 (16385) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/03 03:43:51 (16393) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:45:56 (16416) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/03 03:45:56 (16416) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/03 03:45:56 (16416) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/03 03:50:07 (16476) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 03:50:57 (16483) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/03 03:50:57 (16483) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/03 03:50:57 (16483) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/03 03:55:58 (16536) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/03 03:55:58 (16536) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/03 03:55:58 (16536) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/03 03:59:43 (16982) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:00:48 (17113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:00:59 (17153) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/03 04:00:59 (17153) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/03 04:00:59 (17153) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/03 04:06:01 (17181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/03 04:06:01 (17181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/03 04:06:01 (17181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/03 04:08:49 (17203) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:11:02 (17215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/03 04:11:02 (17215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/03 04:11:02 (17215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/03 04:12:46 (17226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:16:03 (17250) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/03 04:16:03 (17250) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/03 04:16:03 (17250) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/03 04:19:42 (17299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:21:04 (17323) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/03 04:21:04 (17323) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/03 04:21:04 (17323) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/03 04:26:05 (17334) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/03 04:26:05 (17334) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/03 04:26:05 (17334) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/03 04:29:17 (17405) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:31:06 (17420) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/03 04:31:06 (17420) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/03 04:31:06 (17420) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/03 04:31:18 (17422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:36:07 (17449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/03 04:36:07 (17449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/03 04:36:07 (17449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/03 04:38:59 (17466) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:41:08 (17478) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/03 04:41:08 (17478) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/03 04:41:08 (17478) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/03 04:42:56 (17488) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:46:09 (17510) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/03 04:46:09 (17510) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/03 04:46:09 (17510) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/03 04:48:08 (17546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 04:51:10 (17580) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/03 04:51:10 (17580) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/03 04:51:10 (17580) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/03 04:56:11 (17592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/03 04:56:11 (17592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/03 04:56:11 (17592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/03 04:58:26 (17642) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:01:12 (17780) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/03 05:01:12 (17780) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/03 05:01:12 (17780) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/03 05:02:52 (17789) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:06:13 (17817) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/03 05:06:13 (17817) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/03 05:06:13 (17817) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/03 05:09:12 (17830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:11:14 (17843) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/03 05:11:14 (17843) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/03 05:11:14 (17843) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/03 05:14:55 (17854) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:16:15 (17880) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/03 05:16:15 (17880) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/03 05:16:15 (17880) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/03 05:18:47 (17912) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:21:16 (17946) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/03 05:21:16 (17946) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/03 05:21:16 (17946) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/03 05:26:17 (17961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/03 05:26:17 (17961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/03 05:26:17 (17961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/03 05:29:23 (18006) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:31:18 (18043) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/03 05:31:18 (18043) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/03 05:31:18 (18043) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/03 05:31:53 (18048) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:36:19 (18085) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/03 05:36:19 (18085) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/03 05:36:19 (18085) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/03 05:40:21 (18097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:41:20 (18104) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/03 05:41:20 (18104) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/03 05:41:20 (18104) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/03 05:42:32 (18110) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:46:21 (18141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/03 05:46:21 (18141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/03 05:46:21 (18141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/03 05:49:53 (18181) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 05:51:23 (18206) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/03 05:51:23 (18206) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/03 05:51:23 (18206) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/03 05:56:24 (18220) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/03 05:56:24 (18220) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/03 05:56:24 (18220) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/03 05:59:20 (18232) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:01:25 (18400) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/03 06:01:25 (18400) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/03 06:01:25 (18400) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/03 06:03:20 (18415) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:06:26 (18442) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/03 06:06:26 (18442) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/03 06:06:26 (18442) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/03 06:09:47 (18454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:11:27 (18466) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/03 06:11:27 (18466) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/03 06:11:27 (18466) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/03 06:14:43 (18481) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:16:28 (18499) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/03 06:16:28 (18499) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/03 06:16:28 (18499) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/03 06:19:06 (18535) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:21:29 (18569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/03 06:21:29 (18569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/03 06:21:29 (18569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/03 06:26:30 (18581) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/03 06:26:30 (18581) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/03 06:26:30 (18581) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/03 06:28:57 (18590) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:31:31 (18645) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/03 06:31:31 (18645) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/03 06:31:31 (18645) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/03 06:34:46 (18681) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:36:32 (18709) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/03 06:36:32 (18709) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/03 06:36:32 (18709) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/03 06:38:01 (18714) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:41:33 (18728) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/03 06:41:33 (18728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/03 06:41:33 (18728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/03 06:42:56 (18734) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:46:34 (18767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/03 06:46:34 (18767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/03 06:46:34 (18767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/03 06:48:45 (18797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 06:51:35 (18835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/03 06:51:35 (18835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/03 06:51:35 (18835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/03 06:56:36 (18848) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/03 06:56:36 (18848) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/03 06:56:36 (18848) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/03 06:57:52 (18853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:01:37 (19021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/03 07:01:37 (19021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/03 07:01:37 (19021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/03 07:03:59 (19092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:06:38 (19123) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/03 07:06:38 (19123) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/03 07:06:38 (19123) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/03 07:07:38 (19128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:11:39 (19142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/03 07:11:39 (19142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/03 07:11:39 (19142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/03 07:14:42 (19156) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:16:40 (19180) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/03 07:16:40 (19180) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/03 07:16:40 (19180) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/03 07:18:16 (19211) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:21:41 (19246) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/03 07:21:41 (19246) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/03 07:21:41 (19246) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/03 07:26:42 (19261) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/03 07:26:42 (19261) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/03 07:26:42 (19261) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/03 07:27:28 (19268) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:31:44 (19348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/03 07:31:44 (19348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/03 07:31:44 (19348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/03 07:31:46 (19349) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:36:44 (19442) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/03 07:36:44 (19442) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/03 07:36:44 (19442) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/03 07:36:53 (19446) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:41:45 (19461) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/03 07:41:45 (19461) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/03 07:41:45 (19461) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/03 07:45:53 (19479) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:46:46 (19496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/03 07:46:46 (19496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/03 07:46:46 (19496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/03 07:47:03 (19500) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:51:47 (19568) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/03 07:51:47 (19568) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/03 07:51:47 (19568) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/03 07:56:48 (19582) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/03 07:56:48 (19582) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/03 07:56:48 (19582) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/03 07:57:20 (19586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 07:59:34 (19601) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:01:49 (19727) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/03 08:01:49 (19727) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/03 08:01:49 (19727) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/03 08:06:27 (19808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:06:50 (19814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/03 08:06:50 (19814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/03 08:06:50 (19814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/03 08:11:51 (19831) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/03 08:11:51 (19831) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/03 08:11:51 (19831) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/03 08:15:31 (19843) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:16:36 (19866) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:16:52 (19874) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/03 08:16:52 (19874) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/03 08:16:52 (19874) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/03 08:21:53 (19936) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/03 08:21:53 (19936) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/03 08:21:53 (19936) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/03 08:26:10 (19947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:26:54 (19956) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/03 08:26:54 (19956) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/03 08:26:54 (19956) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/03 08:29:09 (19965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:31:55 (19990) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/03 08:31:55 (19990) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/03 08:31:55 (19990) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/03 08:35:52 (20046) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:36:56 (20071) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/03 08:36:56 (20071) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/03 08:36:56 (20071) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/03 08:41:57 (20089) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/03 08:41:57 (20089) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/03 08:41:57 (20089) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/03 08:46:10 (20104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:46:36 (20124) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:46:58 (20130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/03 08:46:58 (20130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/03 08:46:58 (20130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/03 08:51:59 (20192) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/03 08:51:59 (20192) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/03 08:51:59 (20192) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/03 08:56:40 (20211) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 08:57:00 (20217) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/03 08:57:00 (20217) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/03 08:57:00 (20217) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/03 08:59:57 (20230) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:02:01 (20357) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/03 09:02:01 (20357) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/03 09:02:01 (20357) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/03 09:06:45 (20413) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:07:02 (20421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/03 09:07:02 (20421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/03 09:07:02 (20421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/03 09:12:03 (20455) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/03 09:12:03 (20455) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/03 09:12:03 (20455) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/03 09:14:05 (20471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:16:02 (20492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:17:05 (20506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/03 09:17:05 (20506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/03 09:17:05 (20506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/03 09:22:06 (20567) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/03 09:22:06 (20567) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/03 09:22:06 (20567) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/03 09:25:10 (20577) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:27:07 (20589) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/03 09:27:07 (20589) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/03 09:27:07 (20589) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/03 09:31:45 (20603) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:32:08 (20623) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/03 09:32:08 (20623) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/03 09:32:08 (20623) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/03 09:35:34 (20637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:37:09 (20651) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/03 09:37:09 (20651) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/03 09:37:09 (20651) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/03 09:42:10 (20721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/03 09:42:10 (20721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/03 09:42:10 (20721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/03 09:44:55 (20734) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:45:25 (20753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:47:11 (20765) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/03 09:47:11 (20765) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/03 09:47:11 (20765) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/03 09:52:12 (20822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/03 09:52:12 (20822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/03 09:52:12 (20822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/03 09:54:58 (20838) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 09:57:13 (20852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/03 09:57:13 (20852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/03 09:57:13 (20852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/03 09:57:36 (20855) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:02:14 (20985) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/03 10:02:14 (20985) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/03 10:02:14 (20985) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/03 10:05:49 (20999) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:07:15 (21009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/03 10:07:15 (21009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/03 10:07:15 (21009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/03 10:12:16 (21086) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/03 10:12:16 (21086) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/03 10:12:16 (21086) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/03 10:14:30 (21093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:15:22 (21113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:17:17 (21130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/03 10:17:17 (21130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/03 10:17:17 (21130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/03 10:22:18 (21192) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/03 10:22:18 (21192) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/03 10:22:18 (21192) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/03 10:25:36 (21200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:27:19 (21211) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/03 10:27:19 (21211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/03 10:27:19 (21211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/03 10:28:59 (21218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:32:20 (21245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/03 10:32:20 (21245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/03 10:32:20 (21245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/03 10:36:04 (21264) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:37:21 (21271) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/03 10:37:21 (21271) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/03 10:37:21 (21271) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/03 10:42:22 (21342) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/03 10:42:22 (21342) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/03 10:42:22 (21342) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/03 10:46:21 (21361) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:47:17 (21372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:47:23 (21388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/03 10:47:23 (21388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/03 10:47:23 (21388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/03 10:52:24 (21448) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/03 10:52:24 (21448) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/03 10:52:24 (21448) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/03 10:56:32 (21467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 10:57:25 (21473) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/03 10:57:25 (21473) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/03 10:57:25 (21473) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/03 11:00:48 (21574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:02:27 (21608) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/03 11:02:27 (21608) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/03 11:02:27 (21608) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/03 11:07:15 (21629) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:07:27 (21635) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/03 11:07:27 (21635) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/03 11:07:27 (21635) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/03 11:12:28 (21685) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/03 11:12:28 (21685) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/03 11:12:28 (21685) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/03 11:16:26 (21722) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:17:29 (21734) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/03 11:17:29 (21734) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/03 11:17:29 (21734) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/03 11:18:43 (21765) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:22:30 (21814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/03 11:22:30 (21814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/03 11:22:30 (21814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/03 11:26:25 (21828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:27:31 (21837) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/03 11:27:31 (21837) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/03 11:27:31 (21837) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/03 11:29:06 (21844) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:32:32 (21874) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/03 11:32:32 (21874) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/03 11:32:32 (21874) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/03 11:36:26 (21888) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:37:33 (21895) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/03 11:37:33 (21895) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/03 11:37:33 (21895) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/03 11:42:34 (21913) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/03 11:42:34 (21913) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/03 11:42:34 (21913) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/03 11:45:37 (21985) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:47:35 (21993) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/03 11:47:35 (21993) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/03 11:47:35 (21993) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/03 11:50:27 (22028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:52:36 (22071) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/03 11:52:36 (22071) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/03 11:52:36 (22071) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/03 11:55:05 (22083) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:57:00 (22095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 11:57:37 (22117) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/03 11:57:37 (22117) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/03 11:57:37 (22117) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/03 12:02:38 (22236) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/03 12:02:38 (22236) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/03 12:02:38 (22236) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/03 12:05:59 (22248) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:07:39 (22256) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/03 12:07:39 (22256) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/03 12:07:39 (22256) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/03 12:12:40 (22272) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/03 12:12:40 (22272) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/03 12:12:40 (22272) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/03 12:16:11 (22345) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:17:41 (22356) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/03 12:17:41 (22356) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/03 12:17:41 (22356) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/03 12:18:18 (22363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:22:42 (22435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/03 12:22:42 (22435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/03 12:22:42 (22435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/03 12:24:58 (22450) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:25:15 (22469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:27:43 (22478) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/03 12:27:43 (22478) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/03 12:27:43 (22478) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/03 12:32:44 (22494) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/03 12:32:44 (22494) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/03 12:32:44 (22494) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/03 12:34:51 (22507) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:37:45 (22519) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/03 12:37:45 (22519) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/03 12:37:45 (22519) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/03 12:42:46 (22531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/03 12:42:46 (22531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/03 12:42:46 (22531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/03 12:45:15 (22580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:47:48 (22619) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/03 12:47:48 (22619) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/03 12:47:48 (22619) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/03 12:48:20 (22624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:52:48 (22697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/03 12:52:48 (22697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/03 12:52:48 (22697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/03 12:55:13 (22711) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:55:47 (22731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 12:57:49 (22744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/03 12:57:49 (22744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/03 12:57:49 (22744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/03 13:02:50 (22857) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/03 13:02:50 (22857) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/03 13:02:50 (22857) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/03 13:05:01 (22870) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:07:51 (22882) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/03 13:07:51 (22882) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/03 13:07:51 (22882) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/03 13:12:52 (22898) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/03 13:12:52 (22898) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/03 13:12:52 (22898) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/03 13:15:39 (22914) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:17:53 (22981) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/03 13:17:53 (22981) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/03 13:17:53 (22981) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/03 13:20:51 (23018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:22:54 (23060) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/03 13:22:54 (23060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/03 13:22:54 (23060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/03 13:23:36 (23065) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:25:36 (23089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:27:55 (23101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/03 13:27:55 (23101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/03 13:27:55 (23101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/03 13:32:56 (23120) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/03 13:32:56 (23120) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/03 13:32:56 (23120) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/03 13:35:28 (23128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:37:57 (23139) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/03 13:37:57 (23139) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/03 13:37:57 (23139) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/03 13:42:58 (23152) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/03 13:42:58 (23152) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/03 13:42:58 (23152) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/03 13:46:19 (23172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:47:59 (23223) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/03 13:47:59 (23223) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/03 13:47:59 (23223) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/03 13:50:40 (23281) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:52:01 (23314) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:53:00 (23344) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/03 13:53:00 (23344) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/03 13:53:00 (23344) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/03 13:57:13 (23356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 13:58:01 (23366) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/03 13:58:01 (23366) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/03 13:58:01 (23366) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/03 14:03:02 (23484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/03 14:03:02 (23484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/03 14:03:02 (23484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/03 14:08:03 (23499) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:08:04 (23505) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/03 14:08:04 (23505) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/03 14:08:04 (23505) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/03 14:13:05 (23523) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/03 14:13:05 (23523) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/03 14:13:05 (23523) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/03 14:17:53 (23546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:18:06 (23552) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/03 14:18:06 (23552) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/03 14:18:06 (23552) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/03 14:19:05 (23593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:20:36 (23660) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:23:07 (23685) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/03 14:23:07 (23685) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/03 14:23:07 (23685) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/03 14:28:09 (23714) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/03 14:28:09 (23714) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/03 14:28:09 (23714) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/03 14:28:15 (23715) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:33:09 (23736) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/03 14:33:09 (23736) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/03 14:33:09 (23736) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/03 14:38:10 (23748) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/03 14:38:10 (23748) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/03 14:38:10 (23748) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/03 14:38:37 (23752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:43:11 (23769) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/03 14:43:11 (23769) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/03 14:43:11 (23769) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/03 14:47:47 (23794) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:47:58 (23810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:48:12 (23819) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/03 14:48:12 (23819) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/03 14:48:12 (23819) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/03 14:51:22 (23915) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:53:13 (23944) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/03 14:53:13 (23944) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/03 14:53:13 (23944) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/03 14:57:59 (23970) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 14:58:14 (23976) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/03 14:58:14 (23976) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/03 14:58:14 (23976) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/03 15:03:15 (24141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/03 15:03:15 (24141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/03 15:03:15 (24141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/03 15:07:12 (24152) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:08:16 (24162) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/03 15:08:16 (24162) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/03 15:08:16 (24162) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/03 15:13:17 (24181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/03 15:13:17 (24181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/03 15:13:17 (24181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/03 15:17:50 (24198) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:18:18 (24204) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/03 15:18:18 (24204) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/03 15:18:18 (24204) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/03 15:18:48 (24213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:19:16 (24233) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:23:19 (24343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/03 15:23:19 (24343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/03 15:23:19 (24343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/03 15:28:20 (24366) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/03 15:28:20 (24366) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/03 15:28:20 (24366) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/03 15:28:35 (24370) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:33:21 (24453) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/03 15:33:21 (24453) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/03 15:33:21 (24453) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/03 15:37:37 (24467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:38:22 (24474) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/03 15:38:22 (24474) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/03 15:38:22 (24474) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/03 15:43:23 (24487) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/03 15:43:23 (24487) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/03 15:43:23 (24487) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/03 15:46:03 (24502) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:48:18 (24534) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:48:24 (24540) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/03 15:48:24 (24540) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/03 15:48:24 (24540) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/03 15:51:01 (24582) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:53:25 (24661) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/03 15:53:25 (24661) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/03 15:53:25 (24661) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/03 15:57:29 (24690) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 15:58:26 (24697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/03 15:58:26 (24697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/03 15:58:26 (24697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/03 16:03:27 (24815) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/03 16:03:27 (24815) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/03 16:03:27 (24815) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/03 16:07:13 (24829) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:08:28 (24840) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/03 16:08:28 (24840) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/03 16:08:28 (24840) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/03 16:13:13 (24857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:13:30 (24873) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/03 16:13:30 (24873) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/03 16:13:30 (24873) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/03 16:17:08 (24894) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:18:30 (24901) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/03 16:18:30 (24901) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/03 16:18:30 (24901) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/03 16:20:14 (24939) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:23:31 (25005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/03 16:23:31 (25005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/03 16:23:31 (25005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/03 16:27:08 (25056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:28:32 (25065) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/03 16:28:32 (25065) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/03 16:28:32 (25065) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/03 16:33:33 (25079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/03 16:33:33 (25079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/03 16:33:33 (25079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/03 16:36:10 (25092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:38:34 (25100) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/03 16:38:34 (25100) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/03 16:38:34 (25100) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/03 16:42:19 (25116) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:43:35 (25135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/03 16:43:35 (25135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/03 16:43:35 (25135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/03 16:45:59 (25147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:48:36 (25159) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/03 16:48:36 (25159) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/03 16:48:36 (25159) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/03 16:51:49 (25198) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:53:37 (25233) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/03 16:53:37 (25233) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/03 16:53:37 (25233) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/03 16:56:42 (25312) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 16:58:38 (25320) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/03 16:58:38 (25320) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/03 16:58:38 (25320) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/03 17:03:39 (25440) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/03 17:03:39 (25440) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/03 17:03:39 (25440) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/03 17:07:02 (25451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:08:40 (25458) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/03 17:08:40 (25458) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/03 17:08:40 (25458) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/03 17:12:43 (25480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:13:41 (25497) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/03 17:13:41 (25497) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/03 17:13:41 (25497) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/03 17:17:24 (25517) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:18:42 (25524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/03 17:18:42 (25524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/03 17:18:42 (25524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/03 17:23:11 (25576) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:23:43 (25595) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/03 17:23:43 (25595) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/03 17:23:43 (25595) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/03 17:27:29 (25678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:28:44 (25686) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/03 17:28:44 (25686) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/03 17:28:44 (25686) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/03 17:33:45 (25708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/03 17:33:45 (25708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/03 17:33:45 (25708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/03 17:36:59 (25716) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:38:46 (25723) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/03 17:38:46 (25723) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/03 17:38:46 (25723) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/03 17:43:47 (25744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/03 17:43:47 (25744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/03 17:43:47 (25744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/03 17:44:26 (25752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:46:30 (25773) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:48:48 (25781) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/03 17:48:48 (25781) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/03 17:48:48 (25781) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/03 17:51:35 (25822) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:53:49 (25854) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/03 17:53:49 (25854) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/03 17:53:49 (25854) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/03 17:55:44 (25876) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 17:58:50 (25952) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/03 17:58:50 (25952) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/03 17:58:50 (25952) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/03 18:03:51 (26068) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/03 18:03:51 (26068) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/03 18:03:51 (26068) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/03 18:06:02 (26075) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:08:53 (26087) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/03 18:08:53 (26087) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/03 18:08:53 (26087) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/03 18:11:55 (26105) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:13:54 (26125) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/03 18:13:54 (26125) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/03 18:13:54 (26125) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/03 18:17:00 (26142) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:18:31 (26153) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:18:55 (26169) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/03 18:18:55 (26169) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/03 18:18:55 (26169) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/03 18:23:56 (26218) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/03 18:23:56 (26218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/03 18:23:56 (26218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/03 18:27:46 (26246) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:28:57 (26293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/03 18:28:57 (26293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/03 18:28:57 (26293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/03 18:33:58 (26332) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/03 18:33:58 (26332) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/03 18:33:58 (26332) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/03 18:38:28 (26340) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:38:59 (26350) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/03 18:38:59 (26350) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/03 18:38:59 (26350) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/03 18:40:37 (26363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:44:00 (26386) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/03 18:44:00 (26386) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/03 18:44:00 (26386) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/03 18:48:13 (26403) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:49:01 (26410) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/03 18:49:01 (26410) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/03 18:49:01 (26410) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/03 18:49:43 (26415) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:54:02 (26482) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/03 18:54:02 (26482) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/03 18:54:02 (26482) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/03 18:57:57 (26508) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 18:59:03 (26554) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/03 18:59:03 (26554) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/03 18:59:03 (26554) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/03 19:04:04 (26693) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/03 19:04:04 (26693) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/03 19:04:04 (26693) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/03 19:08:26 (26709) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:09:05 (26717) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/03 19:09:05 (26717) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/03 19:09:05 (26717) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/03 19:10:55 (26727) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:14:06 (26749) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/03 19:14:06 (26749) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/03 19:14:06 (26749) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/03 19:18:21 (26767) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:19:07 (26776) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/03 19:19:07 (26776) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/03 19:19:07 (26776) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/03 19:21:42 (26815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:24:08 (26842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/03 19:24:08 (26842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/03 19:24:08 (26842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/03 19:29:09 (26873) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/03 19:29:09 (26873) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/03 19:29:09 (26873) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/03 19:29:15 (26874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:34:10 (26955) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/03 19:34:10 (26955) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/03 19:34:10 (26955) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/03 19:39:11 (26964) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/03 19:39:11 (26964) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/03 19:39:11 (26964) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/03 19:39:57 (26971) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:40:39 (26986) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:44:12 (27009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/03 19:44:12 (27009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/03 19:44:12 (27009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/03 19:49:13 (27018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/03 19:49:13 (27018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/03 19:49:13 (27018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/03 19:50:45 (27034) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:52:10 (27075) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 19:54:14 (27102) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/03 19:54:14 (27102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/03 19:54:14 (27102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/03 19:59:16 (27130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/03 19:59:16 (27130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/03 19:59:16 (27130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/03 20:00:15 (27227) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:04:16 (27320) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/03 20:04:16 (27320) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/03 20:04:16 (27320) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/03 20:09:17 (27328) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/03 20:09:17 (27328) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/03 20:09:17 (27328) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/03 20:09:59 (27335) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:12:13 (27355) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:14:18 (27373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/03 20:14:18 (27373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/03 20:14:18 (27373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/03 20:19:19 (27384) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/03 20:19:19 (27384) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/03 20:19:19 (27384) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/03 20:19:55 (27388) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:23:26 (27443) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:24:20 (27468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/03 20:24:20 (27468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/03 20:24:20 (27468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/03 20:29:21 (27498) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/03 20:29:21 (27498) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/03 20:29:21 (27498) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/03 20:29:25 (27499) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:34:22 (27576) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/03 20:34:22 (27576) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/03 20:34:22 (27576) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/03 20:39:23 (27589) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/03 20:39:23 (27589) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/03 20:39:23 (27589) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/03 20:39:57 (27593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:44:03 (27616) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:44:24 (27633) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/03 20:44:24 (27633) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/03 20:44:24 (27633) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/03 20:49:25 (27647) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/03 20:49:25 (27647) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/03 20:49:25 (27647) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/03 20:50:46 (27660) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:54:26 (27708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/03 20:54:26 (27708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/03 20:54:26 (27708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/03 20:55:41 (27731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 20:59:27 (27764) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/03 20:59:27 (27764) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/03 20:59:27 (27764) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/03 21:00:51 (27857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:04:28 (27928) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/03 21:04:28 (27928) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/03 21:04:28 (27928) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/03 21:09:29 (27960) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/03 21:09:29 (27960) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/03 21:09:29 (27960) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/03 21:11:34 (27971) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:13:05 (27989) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:14:30 (28017) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/03 21:14:30 (28017) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/03 21:14:30 (28017) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/03 21:19:31 (28033) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/03 21:19:31 (28033) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/03 21:19:31 (28033) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/03 21:20:39 (28042) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:24:20 (28092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:24:32 (28113) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/03 21:24:32 (28113) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/03 21:24:32 (28113) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/03 21:29:33 (28135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/03 21:29:33 (28135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/03 21:29:33 (28135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/03 21:31:08 (28149) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:34:34 (28168) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/03 21:34:34 (28168) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/03 21:34:34 (28168) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/03 21:39:35 (28235) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/03 21:39:35 (28235) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/03 21:39:35 (28235) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/03 21:40:50 (28251) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:40:58 (28257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:44:36 (28280) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/03 21:44:36 (28280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/03 21:44:36 (28280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/03 21:49:38 (28296) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/03 21:49:38 (28296) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/03 21:49:38 (28296) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/03 21:51:35 (28312) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:54:39 (28354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/03 21:54:39 (28354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/03 21:54:39 (28354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/03 21:55:56 (28372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 21:59:40 (28397) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/03 21:59:40 (28397) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/03 21:59:40 (28397) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/03 22:02:08 (28522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:04:41 (28534) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/03 22:04:41 (28534) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/03 22:04:41 (28534) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/03 22:09:42 (28607) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/03 22:09:42 (28607) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/03 22:09:42 (28607) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/03 22:09:55 (28608) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:13:02 (28639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:14:43 (28647) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/03 22:14:43 (28647) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/03 22:14:43 (28647) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/03 22:19:44 (28660) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/03 22:19:44 (28660) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/03 22:19:44 (28660) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/03 22:22:06 (28677) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:24:45 (28712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/03 22:24:45 (28712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/03 22:24:45 (28712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/03 22:26:23 (28740) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:29:46 (28765) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/03 22:29:46 (28765) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/03 22:29:46 (28765) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/03 22:32:27 (28778) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:34:47 (28792) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/03 22:34:47 (28792) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/03 22:34:47 (28792) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/03 22:37:21 (28840) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:39:48 (28881) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/03 22:39:48 (28881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/03 22:39:48 (28881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/03 22:42:24 (28898) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:44:49 (28906) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/03 22:44:49 (28906) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/03 22:44:49 (28906) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/03 22:49:50 (28915) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/03 22:49:50 (28915) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/03 22:49:50 (28915) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/03 22:52:38 (28959) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:54:51 (28967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/03 22:54:51 (28967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/03 22:54:51 (28967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/03 22:56:08 (28994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 22:59:52 (29065) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/03 22:59:52 (29065) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/03 22:59:52 (29065) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/03 23:02:32 (29183) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:04:53 (29198) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/03 23:04:53 (29198) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/03 23:04:53 (29198) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/03 23:08:51 (29252) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:09:54 (29287) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/03 23:09:54 (29287) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/03 23:09:54 (29287) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/03 23:11:38 (29305) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:14:55 (29317) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/03 23:14:55 (29317) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/03 23:14:55 (29317) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/03 23:19:56 (29329) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/03 23:19:56 (29329) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/03 23:19:56 (29329) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/03 23:20:52 (29338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:24:46 (29387) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:24:57 (29403) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/03 23:24:57 (29403) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/03 23:24:57 (29403) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/03 23:29:58 (29433) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/03 23:29:58 (29433) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/03 23:29:58 (29433) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/03 23:31:03 (29444) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:34:59 (29523) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/03 23:34:59 (29523) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/03 23:34:59 (29523) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/03 23:40:00 (29575) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:40:00 (29584) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/03 23:40:00 (29584) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/03 23:40:00 (29584) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/03 23:40:46 (29605) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:45:01 (29639) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/03 23:45:01 (29639) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/03 23:45:01 (29639) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/03 23:50:03 (29652) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/03 23:50:03 (29652) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/03 23:50:03 (29652) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/03 23:50:20 (29657) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:51:32 (29674) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/03 23:55:03 (29735) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/03 23:55:03 (29735) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/03 23:55:03 (29735) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/04 00:00:04 (29815) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/04 00:00:04 (29815) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/04 00:00:04 (29815) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/04 00:00:53 (29861) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:05:05 (29899) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/04 00:05:05 (29899) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/04 00:05:05 (29899) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/04 00:10:06 (29926) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/04 00:10:06 (29926) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/04 00:10:06 (29926) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/04 00:10:13 (29927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:10:20 (29937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:15:07 (30020) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/04 00:15:07 (30020) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/04 00:15:07 (30020) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/04 00:19:34 (30064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:20:08 (30074) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/04 00:20:08 (30074) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/04 00:20:08 (30074) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/04 00:22:53 (30117) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:25:09 (30135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/04 00:25:09 (30135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/04 00:25:09 (30135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/04 00:29:21 (30167) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:30:10 (30177) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/04 00:30:10 (30177) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/04 00:30:10 (30177) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/04 00:35:11 (30191) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/04 00:35:11 (30191) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/04 00:35:11 (30191) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/04 00:39:40 (30210) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:40:12 (30220) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/04 00:40:12 (30220) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/04 00:40:12 (30220) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/04 00:43:02 (30271) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:45:13 (30310) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/04 00:45:13 (30310) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/04 00:45:13 (30310) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/04 00:50:14 (30329) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/04 00:50:14 (30329) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/04 00:50:14 (30329) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/04 00:50:20 (30331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:52:27 (30350) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 00:55:15 (30396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/04 00:55:15 (30396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/04 00:55:15 (30396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/04 01:00:16 (30517) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/04 01:00:16 (30517) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/04 01:00:16 (30517) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/04 01:01:00 (30527) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:05:24 (30621) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/04 01:05:24 (30621) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/04 01:05:24 (30621) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/04 01:05:50 (30725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:06:25 (30744) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:07:08 (30764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:10:25 (30798) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/04 01:10:25 (30798) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/04 01:10:25 (30798) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/04 01:15:01 (30862) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:15:26 (30874) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/04 01:15:26 (30874) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/04 01:15:26 (30874) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/04 01:20:27 (30895) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/04 01:20:27 (30895) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/04 01:20:27 (30895) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/04 01:25:28 (30927) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/04 01:25:28 (30927) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/04 01:25:28 (30927) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/04 01:25:37 (30932) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:30:29 (30974) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/04 01:30:29 (30974) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/04 01:30:29 (30974) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/04 01:35:30 (30983) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/04 01:35:30 (30983) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/04 01:35:30 (30983) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/04 01:36:04 (30987) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:39:09 (31018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:39:37 (31036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:40:31 (31057) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/04 01:40:31 (31057) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/04 01:40:31 (31057) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/04 01:45:32 (31106) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/04 01:45:32 (31106) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/04 01:45:32 (31106) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/04 01:46:09 (31129) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 01:50:33 (31153) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/04 01:50:33 (31153) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/04 01:50:33 (31153) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/04 01:55:34 (31183) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/04 01:55:34 (31183) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/04 01:55:34 (31183) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/04 01:56:06 (31201) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:00:35 (31321) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/04 02:00:35 (31321) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/04 02:00:35 (31321) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/04 02:05:36 (31351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/04 02:05:36 (31351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/04 02:05:36 (31351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/04 02:06:21 (31356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:07:36 (31376) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:10:05 (31412) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:10:37 (31431) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/04 02:10:37 (31431) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/04 02:10:37 (31431) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/04 02:15:38 (31483) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/04 02:15:38 (31483) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/04 02:15:38 (31483) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/04 02:15:43 (31484) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:20:39 (31529) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/04 02:20:39 (31529) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/04 02:20:39 (31529) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/04 02:25:33 (31564) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:25:40 (31570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/04 02:25:40 (31570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/04 02:25:40 (31570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/04 02:30:41 (31668) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/04 02:30:41 (31668) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/04 02:30:41 (31668) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/04 02:34:58 (31679) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:35:42 (31686) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/04 02:35:42 (31686) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/04 02:35:42 (31686) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/04 02:39:23 (31711) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:40:43 (31734) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/04 02:40:43 (31734) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/04 02:40:43 (31734) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/04 02:42:32 (31741) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:45:19 (31764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:45:44 (31774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/04 02:45:44 (31774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/04 02:45:44 (31774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/04 02:50:45 (31847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/04 02:50:45 (31847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/04 02:50:45 (31847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/04 02:55:05 (31882) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 02:55:47 (31889) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/04 02:55:47 (31889) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/04 02:55:47 (31889) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/04 03:00:47 (32010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/04 03:00:47 (32010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/04 03:00:47 (32010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/04 03:05:41 (32047) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:05:48 (32053) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/04 03:05:48 (32053) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/04 03:05:48 (32053) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/04 03:10:49 (32082) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/04 03:10:49 (32082) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/04 03:10:49 (32082) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/04 03:11:54 (32088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:14:12 (32113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:15:36 (32134) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:15:50 (32140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/04 03:15:50 (32140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/04 03:15:50 (32140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/04 03:20:51 (32220) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/04 03:20:51 (32220) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/04 03:20:51 (32220) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/04 03:24:48 (32254) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:25:52 (32261) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/04 03:25:52 (32261) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/04 03:25:52 (32261) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/04 03:30:53 (32307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/04 03:30:53 (32307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/04 03:30:53 (32307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/04 03:34:32 (32318) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:35:54 (32325) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/04 03:35:54 (32325) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/04 03:35:54 (32325) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/04 03:40:55 (32372) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/04 03:40:55 (32372) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/04 03:40:55 (32372) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/04 03:41:10 (32373) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:42:55 (32395) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:45:09 (32416) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:45:56 (32423) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/04 03:45:56 (32423) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/04 03:45:56 (32423) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/04 03:50:57 (32498) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/04 03:50:57 (32498) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/04 03:50:57 (32498) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/04 03:54:19 (32532) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 03:55:58 (32540) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/04 03:55:58 (32540) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/04 03:55:58 (32540) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/04 04:00:59 (32663) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/04 04:00:59 (32663) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/04 04:00:59 (32663) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/04 04:03:22 (32694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:06:00 (32705) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/04 04:06:00 (32705) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/04 04:06:00 (32705) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/04 04:10:36 (32738) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:11:01 (32754) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/04 04:11:01 (32754) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/04 04:11:01 (32754) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/04 04:11:46 (32762) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:13:22 (316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:16:02 (325) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/04 04:16:02 (325) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/04 04:16:02 (325) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/04 04:21:03 (383) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/04 04:21:03 (383) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/04 04:21:03 (383) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/04 04:24:16 (440) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:26:04 (449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/04 04:26:04 (449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/04 04:26:04 (449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/04 04:31:05 (486) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/04 04:31:05 (486) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/04 04:31:05 (486) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/04 04:33:54 (496) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:36:06 (504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/04 04:36:06 (504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/04 04:36:06 (504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/04 04:40:08 (840) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:41:07 (857) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/04 04:41:07 (857) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/04 04:41:07 (857) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/04 04:41:52 (871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:44:04 (892) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:46:08 (900) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/04 04:46:08 (900) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/04 04:46:08 (900) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/04 04:51:10 (918) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/04 04:51:10 (918) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/04 04:51:10 (918) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/04 04:53:25 (985) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 04:56:11 (1010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/04 04:56:11 (1010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/04 04:56:11 (1010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/04 05:01:12 (1164) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/04 05:01:12 (1164) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/04 05:01:12 (1164) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/04 05:02:46 (1173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:06:13 (1189) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/04 05:06:13 (1189) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/04 05:06:13 (1189) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/04 05:09:33 (1205) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:10:22 (1229) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:11:14 (1251) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/04 05:11:14 (1251) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/04 05:11:14 (1251) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/04 05:13:44 (1271) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:16:15 (1279) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/04 05:16:15 (1279) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/04 05:16:15 (1279) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/04 05:21:16 (1298) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/04 05:21:16 (1298) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/04 05:21:16 (1298) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/04 05:24:41 (1400) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:26:17 (1407) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/04 05:26:17 (1407) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/04 05:26:17 (1407) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/04 05:31:18 (1447) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/04 05:31:18 (1447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/04 05:31:18 (1447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/04 05:35:01 (1460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:36:19 (1479) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/04 05:36:19 (1479) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/04 05:36:19 (1479) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/04 05:36:42 (1481) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:41:20 (1514) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/04 05:41:20 (1514) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/04 05:41:20 (1514) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/04 05:42:47 (1533) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:44:42 (1559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:46:21 (1566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/04 05:46:21 (1566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/04 05:46:21 (1566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/04 05:51:22 (1581) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/04 05:51:22 (1581) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/04 05:51:22 (1581) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/04 05:55:12 (1672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 05:56:23 (1686) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/04 05:56:23 (1686) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/04 05:56:23 (1686) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/04 06:01:24 (1825) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/04 06:01:24 (1825) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/04 06:01:24 (1825) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/04 06:05:13 (1846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:06:25 (1855) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/04 06:06:25 (1855) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/04 06:06:25 (1855) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/04 06:09:28 (1867) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:11:10 (1911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:11:26 (1928) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/04 06:11:26 (1928) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/04 06:11:26 (1928) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/04 06:14:16 (1937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:16:27 (1949) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/04 06:16:27 (1949) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/04 06:16:27 (1949) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/04 06:21:28 (1967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/04 06:21:28 (1967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/04 06:21:28 (1967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/04 06:23:43 (1976) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:26:29 (2067) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/04 06:26:29 (2067) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/04 06:26:29 (2067) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/04 06:31:31 (2103) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/04 06:31:31 (2103) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/04 06:31:31 (2103) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/04 06:32:46 (2114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:36:32 (2131) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/04 06:36:32 (2131) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/04 06:36:32 (2131) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/04 06:37:08 (2142) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:39:52 (2168) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:41:33 (2202) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/04 06:41:33 (2202) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/04 06:41:33 (2202) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/04 06:41:57 (2207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:46:34 (2219) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/04 06:46:34 (2219) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/04 06:46:34 (2219) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/04 06:51:02 (2255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 06:51:35 (2263) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/04 06:51:35 (2263) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/04 06:51:35 (2263) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/04 06:56:36 (2334) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/04 06:56:36 (2334) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/04 06:56:36 (2334) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/04 07:00:39 (2512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:01:37 (2536) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/04 07:01:37 (2536) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/04 07:01:37 (2536) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/04 07:06:38 (2549) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/04 07:06:38 (2549) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/04 07:06:38 (2549) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/04 07:07:09 (2551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:09:36 (2575) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:10:40 (2610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:11:39 (2620) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/04 07:11:39 (2620) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/04 07:11:39 (2620) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/04 07:16:40 (2633) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/04 07:16:40 (2633) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/04 07:16:40 (2633) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/04 07:21:21 (2654) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:21:41 (2661) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/04 07:21:41 (2661) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/04 07:21:41 (2661) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/04 07:26:42 (2693) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/04 07:26:42 (2693) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/04 07:26:42 (2693) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/04 07:31:43 (2791) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/04 07:31:43 (2791) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/04 07:31:43 (2791) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/04 07:31:47 (2792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:36:25 (2871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:36:44 (2888) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/04 07:36:44 (2888) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/04 07:36:44 (2888) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/04 07:39:23 (2901) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:41:27 (2935) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:41:45 (2942) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/04 07:41:45 (2942) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/04 07:41:45 (2942) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/04 07:46:46 (2954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/04 07:46:46 (2954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/04 07:46:46 (2954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/04 07:51:19 (2969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 07:51:47 (2979) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/04 07:51:47 (2979) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/04 07:51:47 (2979) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/04 07:56:48 (3015) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/04 07:56:48 (3015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/04 07:56:48 (3015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/04 08:01:07 (3213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:01:49 (3222) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/04 08:01:49 (3222) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/04 08:01:49 (3222) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/04 08:04:01 (3233) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:06:50 (3256) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/04 08:06:50 (3256) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/04 08:06:50 (3256) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/04 08:07:10 (3257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:11:51 (3301) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/04 08:11:51 (3301) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/04 08:11:51 (3301) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/04 08:12:00 (3302) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:16:52 (3318) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/04 08:16:52 (3318) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/04 08:16:52 (3318) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/04 08:21:54 (3333) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/04 08:21:54 (3333) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/04 08:21:54 (3333) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/04 08:22:10 (3337) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:26:55 (3375) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/04 08:26:55 (3375) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/04 08:26:55 (3375) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/04 08:31:56 (3471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/04 08:31:56 (3471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/04 08:31:56 (3471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/04 08:32:00 (3472) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:33:57 (3486) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:35:18 (3509) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:36:57 (3527) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/04 08:36:57 (3527) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/04 08:36:57 (3527) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/04 08:41:58 (3555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/04 08:41:58 (3555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/04 08:41:58 (3555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/04 08:42:41 (3559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:46:59 (3574) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/04 08:46:59 (3574) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/04 08:46:59 (3574) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/04 08:52:00 (3588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/04 08:52:00 (3588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/04 08:52:00 (3588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/04 08:52:52 (3595) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 08:57:01 (3629) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/04 08:57:01 (3629) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/04 08:57:01 (3629) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/04 09:02:02 (3826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/04 09:02:02 (3826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/04 09:02:02 (3826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/04 09:03:33 (3838) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:04:05 (3849) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:05:18 (3874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:07:03 (3895) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/04 09:07:03 (3895) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/04 09:07:03 (3895) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/04 09:12:04 (3918) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/04 09:12:04 (3918) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/04 09:12:04 (3918) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/04 09:13:35 (3926) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:17:05 (3941) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/04 09:17:05 (3941) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/04 09:17:05 (3941) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/04 09:22:06 (3954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/04 09:22:06 (3954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/04 09:22:06 (3954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/04 09:23:02 (3962) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:27:07 (3999) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/04 09:27:07 (3999) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/04 09:27:07 (3999) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/04 09:32:08 (4071) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/04 09:32:08 (4071) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/04 09:32:08 (4071) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/04 09:33:39 (4101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:33:54 (4126) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:36:53 (4144) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:37:09 (4163) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/04 09:37:09 (4163) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/04 09:37:09 (4163) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/04 09:42:10 (4181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/04 09:42:10 (4181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/04 09:42:10 (4181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/04 09:44:39 (4191) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:47:11 (4203) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/04 09:47:11 (4203) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/04 09:47:11 (4203) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/04 09:52:12 (4219) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/04 09:52:12 (4219) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/04 09:52:12 (4219) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/04 09:54:57 (4226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 09:57:13 (4261) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/04 09:57:13 (4261) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/04 09:57:13 (4261) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/04 10:02:14 (4409) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/04 10:02:14 (4409) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/04 10:02:14 (4409) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/04 10:03:06 (4450) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:04:00 (4473) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:05:02 (4521) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:07:16 (4535) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/04 10:07:16 (4535) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/04 10:07:16 (4535) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/04 10:12:17 (4552) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/04 10:12:17 (4552) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/04 10:12:17 (4552) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/04 10:15:09 (4561) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:17:18 (4602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/04 10:17:18 (4602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/04 10:17:18 (4602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/04 10:22:19 (4654) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/04 10:22:19 (4654) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/04 10:22:19 (4654) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/04 10:25:47 (4674) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:27:20 (4709) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/04 10:27:20 (4709) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/04 10:27:20 (4709) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/04 10:31:38 (4784) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:32:04 (4801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:32:21 (4817) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/04 10:32:21 (4817) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/04 10:32:21 (4817) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/04 10:35:14 (4873) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:37:22 (4907) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/04 10:37:22 (4907) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/04 10:37:22 (4907) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/04 10:42:23 (4919) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/04 10:42:23 (4919) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/04 10:42:23 (4919) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/04 10:45:24 (4933) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:47:24 (4944) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/04 10:47:24 (4944) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/04 10:47:24 (4944) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/04 10:52:25 (4957) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/04 10:52:25 (4957) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/04 10:52:25 (4957) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/04 10:54:34 (4965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 10:57:26 (5000) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/04 10:57:26 (5000) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/04 10:57:26 (5000) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/04 10:58:25 (5008) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:00:38 (5172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:02:27 (5211) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/04 11:02:27 (5211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/04 11:02:27 (5211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/04 11:04:38 (5223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:07:28 (5297) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/04 11:07:28 (5297) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/04 11:07:28 (5297) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/04 11:12:29 (5312) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/04 11:12:29 (5312) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/04 11:12:29 (5312) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/04 11:14:43 (5321) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:17:30 (5336) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/04 11:17:30 (5336) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/04 11:17:30 (5336) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/04 11:22:31 (5349) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/04 11:22:31 (5349) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/04 11:22:31 (5349) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/04 11:23:43 (5354) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:25:12 (5368) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:27:32 (5413) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/04 11:27:32 (5413) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/04 11:27:32 (5413) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/04 11:32:06 (5454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:32:33 (5471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/04 11:32:33 (5471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/04 11:32:33 (5471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/04 11:33:10 (5480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:37:34 (5535) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/04 11:37:34 (5535) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/04 11:37:34 (5535) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/04 11:42:30 (5582) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:42:35 (5588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/04 11:42:35 (5588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/04 11:42:35 (5588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/04 11:47:36 (5599) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/04 11:47:36 (5599) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/04 11:47:36 (5599) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/04 11:51:30 (5649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:52:37 (5663) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/04 11:52:37 (5663) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/04 11:52:37 (5663) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/04 11:52:57 (5665) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 11:57:39 (5718) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/04 11:57:39 (5718) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/04 11:57:39 (5718) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/04 12:01:31 (5864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:01:57 (5884) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:02:40 (5890) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/04 12:02:40 (5890) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/04 12:02:40 (5890) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/04 12:07:41 (5940) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/04 12:07:41 (5940) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/04 12:07:41 (5940) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/04 12:12:18 (5985) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:12:42 (5991) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/04 12:12:42 (5991) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/04 12:12:42 (5991) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/04 12:17:43 (6005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/04 12:17:43 (6005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/04 12:17:43 (6005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/04 12:21:58 (6021) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:22:44 (6027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/04 12:22:44 (6027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/04 12:22:44 (6027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/04 12:25:17 (6037) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:27:45 (6081) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/04 12:27:45 (6081) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/04 12:27:45 (6081) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/04 12:29:11 (6088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:32:11 (6145) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:32:46 (6151) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/04 12:32:46 (6151) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/04 12:32:46 (6151) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/04 12:37:47 (6162) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/04 12:37:47 (6162) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/04 12:37:47 (6162) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/04 12:41:25 (6240) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:42:48 (6276) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/04 12:42:48 (6276) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/04 12:42:48 (6276) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/04 12:47:49 (6694) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/04 12:47:49 (6694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/04 12:47:49 (6694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/04 12:51:00 (6709) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:52:26 (6752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 12:52:50 (6792) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/04 12:52:50 (6792) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/04 12:52:50 (6792) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/04 12:57:51 (6863) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/04 12:57:51 (6863) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/04 12:57:51 (6863) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/04 13:00:29 (6932) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:01:08 (6984) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:02:52 (6996) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/04 13:02:52 (6996) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/04 13:02:52 (6996) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/04 13:07:53 (7008) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/04 13:07:53 (7008) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/04 13:07:53 (7008) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/04 13:10:42 (7064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:12:54 (7095) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/04 13:12:54 (7095) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/04 13:12:54 (7095) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/04 13:17:55 (7108) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/04 13:17:55 (7108) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/04 13:17:55 (7108) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/04 13:20:40 (7122) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:22:56 (7135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/04 13:22:56 (7135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/04 13:22:56 (7135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/04 13:23:06 (7136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:27:57 (7189) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/04 13:27:57 (7189) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/04 13:27:57 (7189) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/04 13:30:59 (7229) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:31:30 (7237) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:32:58 (7256) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/04 13:32:58 (7256) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/04 13:32:58 (7256) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/04 13:37:59 (7308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/04 13:37:59 (7308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/04 13:37:59 (7308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/04 13:40:29 (7325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:43:00 (7388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/04 13:43:00 (7388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/04 13:43:00 (7388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/04 13:48:01 (7437) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/04 13:48:01 (7437) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/04 13:48:01 (7437) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/04 13:49:42 (7444) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:53:02 (7462) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/04 13:53:02 (7462) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/04 13:53:02 (7462) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/04 13:55:27 (7469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 13:58:03 (7518) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/04 13:58:03 (7518) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/04 13:58:03 (7518) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/04 14:00:28 (7588) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:03:04 (7630) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/04 14:03:04 (7630) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/04 14:03:04 (7630) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/04 14:03:22 (7631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:08:05 (7663) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/04 14:08:05 (7663) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/04 14:08:05 (7663) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/04 14:10:03 (7682) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:13:06 (7729) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/04 14:13:06 (7729) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/04 14:13:06 (7729) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/04 14:18:07 (7766) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/04 14:18:07 (7766) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/04 14:18:07 (7766) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/04 14:21:03 (7780) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:23:08 (7788) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/04 14:23:08 (7788) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/04 14:23:08 (7788) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/04 14:25:19 (7795) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:28:09 (7846) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/04 14:28:09 (7846) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/04 14:28:09 (7846) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/04 14:30:19 (7868) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:31:51 (7893) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:33:10 (7911) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/04 14:33:10 (7911) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/04 14:33:10 (7911) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/04 14:38:11 (7926) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/04 14:38:11 (7926) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/04 14:38:11 (7926) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/04 14:40:36 (7941) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:43:12 (7953) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/04 14:43:12 (7953) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/04 14:43:12 (7953) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/04 14:48:13 (8021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/04 14:48:13 (8021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/04 14:48:13 (8021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/04 14:50:37 (8035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:53:14 (8045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/04 14:53:14 (8045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/04 14:53:14 (8045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/04 14:55:32 (8054) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 14:58:15 (8106) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/04 14:58:15 (8106) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/04 14:58:15 (8106) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/04 14:59:35 (8165) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:00:10 (8233) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:03:16 (8281) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/04 15:03:16 (8281) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/04 15:03:16 (8281) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/04 15:08:17 (8294) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/04 15:08:17 (8294) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/04 15:08:17 (8294) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/04 15:10:14 (8310) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:13:18 (8321) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/04 15:13:18 (8321) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/04 15:13:18 (8321) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/04 15:18:19 (8394) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/04 15:18:19 (8394) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/04 15:18:19 (8394) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/04 15:20:46 (8409) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:23:21 (8422) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/04 15:23:21 (8422) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/04 15:23:21 (8422) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/04 15:23:36 (8425) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:27:41 (8454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:28:22 (8498) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/04 15:28:22 (8498) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/04 15:28:22 (8498) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/04 15:31:38 (8534) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:33:23 (8542) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/04 15:33:23 (8542) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/04 15:33:23 (8542) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/04 15:38:24 (8619) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/04 15:38:24 (8619) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/04 15:38:24 (8619) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/04 15:40:59 (8632) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:43:25 (8645) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/04 15:43:25 (8645) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/04 15:43:25 (8645) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/04 15:48:26 (8718) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/04 15:48:26 (8718) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/04 15:48:26 (8718) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/04 15:50:12 (8730) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:51:52 (8741) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 15:53:27 (8759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/04 15:53:27 (8759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/04 15:53:27 (8759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/04 15:58:28 (8805) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/04 15:58:28 (8805) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/04 15:58:28 (8805) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/04 15:58:50 (8806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:00:44 (8890) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:03:29 (8936) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/04 16:03:29 (8936) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/04 16:03:29 (8936) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/04 16:08:30 (8947) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/04 16:08:30 (8947) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/04 16:08:30 (8947) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/04 16:11:11 (8961) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:13:31 (8969) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/04 16:13:31 (8969) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/04 16:13:31 (8969) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/04 16:18:32 (9043) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/04 16:18:32 (9043) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/04 16:18:32 (9043) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/04 16:19:03 (9056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:21:21 (9082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:23:33 (9090) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/04 16:23:33 (9090) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/04 16:23:33 (9090) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/04 16:28:34 (9127) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/04 16:28:34 (9127) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/04 16:28:34 (9127) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/04 16:29:15 (9133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:30:54 (9169) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:33:35 (9194) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/04 16:33:35 (9194) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/04 16:33:35 (9194) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/04 16:38:36 (9210) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/04 16:38:36 (9210) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/04 16:38:36 (9210) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/04 16:40:00 (9218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:43:37 (9238) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/04 16:43:37 (9238) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/04 16:43:37 (9238) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/04 16:48:14 (9288) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:48:38 (9304) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/04 16:48:38 (9304) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/04 16:48:38 (9304) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/04 16:49:02 (9308) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:53:39 (9357) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/04 16:53:39 (9357) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/04 16:53:39 (9357) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/04 16:58:38 (9399) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 16:58:40 (9405) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/04 16:58:40 (9405) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/04 16:58:40 (9405) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/04 17:01:48 (9489) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:03:41 (9526) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/04 17:03:41 (9526) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/04 17:03:41 (9526) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/04 17:08:42 (9542) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:08:43 (9548) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/04 17:08:43 (9548) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/04 17:08:43 (9548) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/04 17:13:44 (9567) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/04 17:13:44 (9567) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/04 17:13:44 (9567) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/04 17:18:28 (9584) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:18:46 (9590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/04 17:18:46 (9590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/04 17:18:46 (9590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/04 17:20:48 (9654) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:23:46 (9684) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/04 17:23:46 (9684) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/04 17:23:46 (9684) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/04 17:28:09 (9697) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:28:47 (9728) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/04 17:28:47 (9728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/04 17:28:47 (9728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/04 17:33:48 (9764) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/04 17:33:48 (9764) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/04 17:33:48 (9764) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/04 17:35:17 (9777) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:38:47 (9802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:38:49 (9808) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/04 17:38:49 (9808) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/04 17:38:49 (9808) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/04 17:43:50 (9823) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/04 17:43:50 (9823) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/04 17:43:50 (9823) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/04 17:47:56 (9835) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:48:51 (9842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/04 17:48:51 (9842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/04 17:48:51 (9842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/04 17:51:55 (9910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:53:52 (9938) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/04 17:53:52 (9938) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/04 17:53:52 (9938) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/04 17:57:37 (9953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 17:58:53 (9984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/04 17:58:53 (9984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/04 17:58:53 (9984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/04 18:03:54 (10095) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/04 18:03:54 (10095) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/04 18:03:54 (10095) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/04 18:04:34 (10104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:07:07 (10125) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:08:55 (10133) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/04 18:08:55 (10133) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/04 18:08:55 (10133) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/04 18:13:56 (10151) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/04 18:13:56 (10151) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/04 18:13:56 (10151) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/04 18:16:12 (10161) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:18:57 (10172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:18:57 (10172) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 18:18:57 (10172) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 18:18:57 (10172) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 18:21:28 (10189) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:23:58 (10271) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/04 18:23:58 (10271) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/04 18:23:58 (10271) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/04 18:25:38 (10280) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:28:59 (10313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:28:59 (10313) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 18:28:59 (10313) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 18:28:59 (10313) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 18:34:00 (10365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/04 18:34:00 (10365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/04 18:34:00 (10365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/04 18:34:26 (10371) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:35:31 (10391) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:39:01 (10400) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:39:01 (10400) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 18:39:01 (10400) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 18:39:01 (10400) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 18:44:02 (10420) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/04 18:44:02 (10420) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/04 18:44:02 (10420) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/04 18:46:19 (10430) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:49:03 (10438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/04 18:49:03 (10438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/04 18:49:03 (10438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/04 18:50:57 (10449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:54:04 (10518) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/04 18:54:04 (10518) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/04 18:54:04 (10518) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/04 18:57:01 (10549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 18:59:05 (10581) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/04 18:59:05 (10581) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/04 18:59:05 (10581) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/04 19:03:06 (10685) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:04:06 (10708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/04 19:04:06 (10708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/04 19:04:06 (10708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/04 19:06:01 (10721) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:09:07 (10730) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:09:08 (10730) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 19:09:08 (10730) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 19:09:08 (10730) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 19:14:08 (10752) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/04 19:14:08 (10752) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/04 19:14:08 (10752) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/04 19:16:40 (10764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:19:09 (10772) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:19:09 (10772) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 19:19:09 (10772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 19:19:09 (10772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 19:22:24 (10787) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:24:10 (10847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/04 19:24:10 (10847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/04 19:24:10 (10847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/04 19:26:02 (10874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:29:11 (10914) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:29:11 (10914) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 19:29:11 (10914) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 19:29:11 (10914) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 19:33:16 (10956) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:34:12 (10979) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/04 19:34:12 (10979) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/04 19:34:12 (10979) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/04 19:35:33 (10985) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:39:13 (10996) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:39:13 (10996) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 19:39:13 (10996) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 19:39:13 (10996) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 19:44:14 (11018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/04 19:44:14 (11018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/04 19:44:14 (11018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/04 19:45:56 (11024) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:49:15 (11037) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/04 19:49:15 (11037) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/04 19:49:15 (11037) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/04 19:50:16 (11047) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:54:16 (11079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/04 19:54:16 (11079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/04 19:54:16 (11079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/04 19:55:09 (11084) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 19:59:17 (11178) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/04 19:59:17 (11178) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/04 19:59:17 (11178) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/04 20:02:41 (11261) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:04:18 (11307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/04 20:04:18 (11307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/04 20:04:18 (11307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/04 20:05:25 (11312) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:09:19 (11326) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/04 20:09:19 (11326) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/04 20:09:19 (11326) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/04 20:14:20 (11348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/04 20:14:20 (11348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/04 20:14:20 (11348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/04 20:16:05 (11353) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:19:21 (11365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/04 20:19:21 (11365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/04 20:19:21 (11365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/04 20:22:36 (11377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:24:22 (11403) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/04 20:24:22 (11403) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/04 20:24:22 (11403) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/04 20:26:15 (11539) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:29:23 (11705) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:29:23 (11705) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 20:29:23 (11705) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 20:29:23 (11705) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 20:32:03 (11737) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:34:24 (11783) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/04 20:34:24 (11783) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/04 20:34:24 (11783) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/04 20:36:40 (11795) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:39:25 (11804) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:39:25 (11804) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 20:39:25 (11804) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 20:39:25 (11804) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 20:44:26 (11826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/04 20:44:26 (11826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/04 20:44:26 (11826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/04 20:46:35 (11838) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:49:27 (11847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/04 20:49:27 (11847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/04 20:49:27 (11847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/04 20:54:28 (11864) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/04 20:54:28 (11864) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/04 20:54:28 (11864) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/04 20:54:54 (11866) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:57:24 (11896) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 20:59:29 (11957) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/04 20:59:29 (11957) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/04 20:59:29 (11957) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/04 21:00:14 (12039) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:04:31 (12107) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/04 21:04:31 (12107) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/04 21:04:31 (12107) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/04 21:08:05 (12120) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:09:32 (12128) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/04 21:09:32 (12128) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/04 21:09:32 (12128) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/04 21:14:33 (12146) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:14:33 (12146) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 21:14:33 (12146) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 21:14:33 (12146) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 21:19:04 (12165) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:19:34 (12172) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/04 21:19:34 (12172) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/04 21:19:34 (12172) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/04 21:24:05 (12189) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:24:35 (12206) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:24:35 (12206) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 21:24:35 (12206) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 21:24:35 (12206) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 21:29:13 (12260) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:29:36 (12277) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/04 21:29:36 (12277) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/04 21:29:36 (12277) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/04 21:29:54 (12299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:34:37 (12368) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:34:37 (12368) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 21:34:37 (12368) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 21:34:37 (12368) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 21:39:38 (12379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/04 21:39:38 (12379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/04 21:39:38 (12379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/04 21:40:42 (12388) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:44:39 (12403) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/04 21:44:39 (12403) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/04 21:44:39 (12403) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/04 21:49:40 (12419) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/04 21:49:40 (12419) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/04 21:49:40 (12419) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/04 21:49:46 (12420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:54:40 (12453) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:54:41 (12469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:54:41 (12469) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 21:54:41 (12469) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 21:54:41 (12469) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 21:59:19 (12486) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:59:22 (12492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 21:59:42 (12509) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/04 21:59:42 (12509) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/04 21:59:42 (12509) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/04 22:04:43 (12694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:04:43 (12694) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 22:04:43 (12694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 22:04:43 (12694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 22:08:22 (12703) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:09:44 (12711) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/04 22:09:44 (12711) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/04 22:09:44 (12711) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/04 22:14:45 (12728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:14:45 (12728) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 22:14:45 (12728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 22:14:45 (12728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 22:18:47 (12748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:19:46 (12756) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/04 22:19:46 (12756) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/04 22:19:46 (12756) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/04 22:24:47 (12775) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/04 22:24:47 (12775) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/04 22:24:47 (12775) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/04 22:25:19 (12780) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:29:25 (12808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:29:48 (12814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/04 22:29:48 (12814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/04 22:29:48 (12814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/04 22:32:33 (12901) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:34:49 (12949) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:34:50 (12949) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 22:34:50 (12949) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 22:34:50 (12949) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 22:39:40 (12960) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:39:51 (12966) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/04 22:39:51 (12966) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/04 22:39:51 (12966) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/04 22:44:52 (12985) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:44:52 (12985) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 22:44:52 (12985) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 22:44:52 (12985) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 22:48:46 (12999) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:49:53 (13006) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/04 22:49:53 (13006) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/04 22:49:53 (13006) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/04 22:54:54 (13028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:54:54 (13028) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 22:54:54 (13028) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 22:54:54 (13028) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 22:57:03 (13037) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:57:52 (13057) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 22:59:55 (13117) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/04 22:59:55 (13117) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/04 22:59:55 (13117) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/04 23:02:06 (13209) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:04:56 (13303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:04:56 (13303) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 23:04:56 (13303) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 23:04:56 (13303) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 23:07:00 (13311) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:09:57 (13320) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/04 23:09:57 (13320) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/04 23:09:57 (13320) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/04 23:14:58 (13338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:14:58 (13338) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/04 23:14:58 (13338) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/04 23:14:58 (13338) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/04 23:16:32 (13346) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:19:59 (13361) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/04 23:19:59 (13361) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/04 23:19:59 (13361) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/04 23:25:00 (13383) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/04 23:25:00 (13383) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/04 23:25:00 (13383) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/04 23:25:44 (13389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:27:06 (13409) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:29:50 (13422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:30:01 (13443) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/04 23:30:01 (13443) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/04 23:30:01 (13443) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/04 23:35:02 (13565) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/04 23:35:02 (13565) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/04 23:35:02 (13565) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/04 23:37:43 (13628) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:40:03 (13642) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/04 23:40:03 (13642) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/04 23:40:03 (13642) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/04 23:45:04 (13658) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/04 23:45:04 (13658) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/04 23:45:04 (13658) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/04 23:48:11 (13672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:50:05 (13684) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/04 23:50:05 (13684) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/04 23:50:05 (13684) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/04 23:55:06 (13709) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/04 23:55:06 (13709) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/04 23:55:06 (13709) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/04 23:55:41 (13715) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:58:24 (13736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/04 23:59:47 (13748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:00:07 (13812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/05 00:00:07 (13812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/05 00:00:07 (13812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/05 00:05:08 (13934) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/05 00:05:08 (13934) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/05 00:05:08 (13934) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/05 00:07:42 (13964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:10:09 (13976) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/05 00:10:09 (13976) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/05 00:10:09 (13976) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/05 00:15:10 (13991) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/05 00:15:10 (13991) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/05 00:15:10 (13991) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/05 00:17:33 (14005) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:20:11 (14017) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/05 00:20:11 (14017) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/05 00:20:11 (14017) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/05 00:23:56 (14035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:25:12 (14055) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/05 00:25:12 (14055) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/05 00:25:12 (14055) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/05 00:26:51 (14065) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:27:00 (14081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:30:14 (14096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/05 00:30:14 (14096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/05 00:30:14 (14096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/05 00:35:14 (14165) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/05 00:35:14 (14165) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/05 00:35:14 (14165) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/05 00:37:19 (14224) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:40:15 (14242) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/05 00:40:15 (14242) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/05 00:40:15 (14242) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/05 00:45:16 (14260) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/05 00:45:16 (14260) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/05 00:45:16 (14260) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/05 00:46:42 (14266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:50:17 (14281) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/05 00:50:17 (14281) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/05 00:50:17 (14281) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/05 00:54:17 (14299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:55:18 (14316) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/05 00:55:18 (14316) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/05 00:55:18 (14316) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/05 00:56:21 (14323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 00:57:53 (14335) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:00:19 (14401) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/05 01:00:19 (14401) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/05 01:00:19 (14401) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/05 01:05:24 (14547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/05 01:05:24 (14547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/05 01:05:24 (14547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/05 01:05:45 (14608) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:08:10 (14677) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:08:37 (14714) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:10:25 (14744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/05 01:10:25 (14744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/05 01:10:25 (14744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/05 01:15:26 (14752) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/05 01:15:26 (14752) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/05 01:15:26 (14752) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/05 01:15:43 (14760) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:20:27 (14789) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/05 01:20:27 (14789) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/05 01:20:27 (14789) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/05 01:25:28 (14795) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/05 01:25:28 (14795) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/05 01:25:28 (14795) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/05 01:25:40 (14800) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:30:29 (14822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/05 01:30:29 (14822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/05 01:30:29 (14822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/05 01:35:30 (14875) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/05 01:35:30 (14875) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/05 01:35:30 (14875) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/05 01:36:01 (14882) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:38:24 (14946) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:38:50 (14964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:40:31 (15009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/05 01:40:31 (15009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/05 01:40:31 (15009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/05 01:45:23 (15020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 01:45:32 (15026) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/05 01:45:32 (15026) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/05 01:45:32 (15026) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/05 01:50:33 (15044) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/05 01:50:33 (15044) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/05 01:50:33 (15044) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/05 01:55:34 (15053) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/05 01:55:34 (15053) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/05 01:55:34 (15053) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/05 01:55:36 (15055) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:00:35 (15127) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/05 02:00:35 (15127) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/05 02:00:35 (15127) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/05 02:05:03 (15206) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:05:36 (15212) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/05 02:05:36 (15212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/05 02:05:36 (15212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/05 02:07:23 (15231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:08:01 (15252) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:10:37 (15343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/05 02:10:37 (15343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/05 02:10:37 (15343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/05 02:14:49 (15356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:15:38 (15363) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/05 02:15:38 (15363) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/05 02:15:38 (15363) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/05 02:20:39 (15384) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/05 02:20:39 (15384) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/05 02:20:39 (15384) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/05 02:23:54 (15391) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:25:40 (15401) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/05 02:25:40 (15401) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/05 02:25:40 (15401) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/05 02:30:42 (15478) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/05 02:30:42 (15478) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/05 02:30:42 (15478) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/05 02:33:34 (15512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:35:42 (15546) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/05 02:35:42 (15546) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/05 02:35:42 (15546) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/05 02:36:36 (15554) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:38:45 (15584) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:40:43 (15644) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/05 02:40:43 (15644) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/05 02:40:43 (15644) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/05 02:42:35 (15676) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:45:44 (15689) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/05 02:45:44 (15689) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/05 02:45:44 (15689) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/05 02:50:45 (15705) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/05 02:50:45 (15705) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/05 02:50:45 (15705) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/05 02:52:08 (15710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 02:55:46 (15723) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/05 02:55:46 (15723) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/05 02:55:46 (15723) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/05 03:00:47 (15782) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/05 03:00:47 (15782) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/05 03:00:47 (15782) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/05 03:01:20 (15807) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:05:21 (15877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:05:48 (15898) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/05 03:05:48 (15898) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/05 03:05:48 (15898) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/05 03:06:14 (15900) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:10:38 (15943) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:10:49 (15950) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/05 03:10:49 (15950) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/05 03:10:49 (15950) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/05 03:15:50 (16018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/05 03:15:50 (16018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/05 03:15:50 (16018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/05 03:20:51 (16039) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/05 03:20:51 (16039) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/05 03:20:51 (16039) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/05 03:21:31 (16043) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:25:52 (16067) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/05 03:25:52 (16067) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/05 03:25:52 (16067) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/05 03:30:53 (16086) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/05 03:30:53 (16086) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/05 03:30:53 (16086) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/05 03:31:55 (16116) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:33:23 (16128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:34:23 (16149) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:35:54 (16188) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/05 03:35:54 (16188) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/05 03:35:54 (16188) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/05 03:40:55 (16202) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/05 03:40:55 (16202) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/05 03:40:55 (16202) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/05 03:41:08 (16210) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:45:56 (16282) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/05 03:45:56 (16282) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/05 03:45:56 (16282) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/05 03:50:39 (16303) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 03:50:57 (16310) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/05 03:50:57 (16310) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/05 03:50:57 (16310) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/05 03:55:58 (16316) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/05 03:55:58 (16316) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/05 03:55:58 (16316) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/05 04:00:39 (16381) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:00:59 (16392) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/05 04:00:59 (16392) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/05 04:00:59 (16392) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/05 04:02:38 (16443) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:04:15 (16465) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:06:00 (16504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/05 04:06:00 (16504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/05 04:06:00 (16504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/05 04:10:19 (16536) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:11:01 (16545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/05 04:11:01 (16545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/05 04:11:01 (16545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/05 04:16:02 (16925) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/05 04:16:02 (16925) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/05 04:16:02 (16925) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/05 04:20:00 (16943) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:21:04 (16954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/05 04:21:04 (16954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/05 04:21:04 (16954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/05 04:26:05 (16960) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/05 04:26:05 (16960) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/05 04:26:05 (16960) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/05 04:30:03 (16980) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:31:06 (16988) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/05 04:31:06 (16988) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/05 04:31:06 (16988) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/05 04:32:04 (17031) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:33:50 (17057) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:36:07 (17096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/05 04:36:07 (17096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/05 04:36:07 (17096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/05 04:39:23 (17116) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:41:08 (17131) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/05 04:41:08 (17131) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/05 04:41:08 (17131) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/05 04:46:09 (17181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/05 04:46:09 (17181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/05 04:46:09 (17181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/05 04:48:54 (17215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 04:51:10 (17230) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/05 04:51:10 (17230) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/05 04:51:10 (17230) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/05 04:56:11 (17236) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/05 04:56:11 (17236) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/05 04:56:11 (17236) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/05 04:59:16 (17245) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:01:12 (17328) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/05 05:01:12 (17328) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/05 05:01:12 (17328) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/05 05:04:19 (17360) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:04:48 (17381) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:06:13 (17419) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/05 05:06:13 (17419) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/05 05:06:13 (17419) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/05 05:09:38 (17435) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:11:14 (17454) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/05 05:11:14 (17454) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/05 05:11:14 (17454) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/05 05:16:15 (17471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/05 05:16:15 (17471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/05 05:16:15 (17471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/05 05:20:13 (17552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:21:16 (17559) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/05 05:21:16 (17559) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/05 05:21:16 (17559) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/05 05:26:17 (17565) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/05 05:26:17 (17565) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/05 05:26:17 (17565) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/05 05:30:00 (17581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:31:18 (17592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/05 05:31:18 (17592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/05 05:31:18 (17592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/05 05:32:32 (17622) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:36:06 (17671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:36:19 (17687) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/05 05:36:19 (17687) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/05 05:36:19 (17687) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/05 05:39:06 (17704) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:41:20 (17718) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/05 05:41:20 (17718) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/05 05:41:20 (17718) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/05 05:46:21 (17728) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/05 05:46:21 (17728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/05 05:46:21 (17728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/05 05:49:41 (17805) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 05:51:22 (17817) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/05 05:51:22 (17817) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/05 05:51:22 (17817) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/05 05:56:23 (17823) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/05 05:56:23 (17823) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/05 05:56:23 (17823) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/05 05:59:45 (17837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:00:46 (17896) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:01:24 (17930) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/05 06:01:24 (17930) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/05 06:01:24 (17930) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/05 06:06:26 (17992) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/05 06:06:26 (17992) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/05 06:06:26 (17992) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/05 06:06:45 (17993) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:09:47 (18025) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:11:26 (18038) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/05 06:11:26 (18038) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/05 06:11:26 (18038) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/05 06:16:27 (18048) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/05 06:16:27 (18048) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/05 06:16:27 (18048) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/05 06:19:07 (18109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:21:28 (18144) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/05 06:21:28 (18144) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/05 06:21:28 (18144) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/05 06:26:29 (18150) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/05 06:26:29 (18150) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/05 06:26:29 (18150) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/05 06:29:24 (18166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:30:03 (18190) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:31:30 (18197) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/05 06:31:30 (18197) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/05 06:31:30 (18197) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/05 06:33:41 (18228) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:36:31 (18272) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/05 06:36:31 (18272) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/05 06:36:31 (18272) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/05 06:40:18 (18299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:41:32 (18306) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/05 06:41:32 (18306) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/05 06:41:32 (18306) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/05 06:46:33 (18312) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/05 06:46:33 (18312) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/05 06:46:33 (18312) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/05 06:49:55 (18369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 06:51:34 (18398) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/05 06:51:34 (18398) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/05 06:51:34 (18398) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/05 06:56:35 (18409) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/05 06:56:35 (18409) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/05 06:56:35 (18409) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/05 07:00:18 (18522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:01:36 (18546) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/05 07:01:36 (18546) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/05 07:01:36 (18546) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/05 07:02:10 (18552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:06:37 (18629) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/05 07:06:37 (18629) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/05 07:06:37 (18629) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/05 07:06:50 (18630) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:11:09 (18670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:11:38 (18676) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/05 07:11:38 (18676) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/05 07:11:38 (18676) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/05 07:16:39 (18688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/05 07:16:39 (18688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/05 07:16:39 (18688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/05 07:21:05 (18751) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:21:40 (18757) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/05 07:21:40 (18757) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/05 07:21:40 (18757) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/05 07:26:41 (18847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/05 07:26:41 (18847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/05 07:26:41 (18847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/05 07:30:45 (18905) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:31:42 (18917) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/05 07:31:42 (18917) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/05 07:31:42 (18917) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/05 07:32:11 (18921) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:36:43 (19041) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/05 07:36:43 (19041) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/05 07:36:43 (19041) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/05 07:36:59 (19058) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:41:22 (19207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:41:44 (19213) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/05 07:41:44 (19213) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/05 07:41:44 (19213) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/05 07:46:45 (19229) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/05 07:46:45 (19229) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/05 07:46:45 (19229) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/05 07:51:46 (19246) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/05 07:51:46 (19246) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/05 07:51:46 (19246) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/05 07:52:20 (19286) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 07:56:48 (19325) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/05 07:56:48 (19325) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/05 07:56:48 (19325) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/05 08:00:13 (19382) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:01:25 (19423) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:01:48 (19429) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/05 08:01:48 (19429) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/05 08:01:48 (19429) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/05 08:06:49 (19478) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/05 08:06:49 (19478) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/05 08:06:49 (19478) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/05 08:08:59 (19503) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:10:55 (19529) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:11:50 (19539) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/05 08:11:50 (19539) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/05 08:11:50 (19539) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/05 08:16:51 (19553) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/05 08:16:51 (19553) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/05 08:16:51 (19553) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/05 08:21:05 (19573) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:21:52 (19582) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/05 08:21:52 (19582) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/05 08:21:52 (19582) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/05 08:26:53 (19651) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/05 08:26:53 (19651) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/05 08:26:53 (19651) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/05 08:29:33 (19662) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:30:17 (19686) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:31:54 (19700) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/05 08:31:54 (19700) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/05 08:31:54 (19700) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/05 08:36:55 (19742) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/05 08:36:55 (19742) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/05 08:36:55 (19742) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/05 08:39:34 (19771) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:40:07 (19799) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:41:56 (19808) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/05 08:41:56 (19808) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/05 08:41:56 (19808) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/05 08:46:57 (19814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/05 08:46:57 (19814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/05 08:46:57 (19814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/05 08:50:40 (19832) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 08:51:58 (19841) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/05 08:51:58 (19841) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/05 08:51:58 (19841) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/05 08:56:59 (19916) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/05 08:56:59 (19916) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/05 08:56:59 (19916) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/05 08:56:59 (19917) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:00:22 (19996) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:02:00 (20021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/05 09:02:00 (20021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/05 09:02:00 (20021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/05 09:07:01 (20068) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/05 09:07:01 (20068) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/05 09:07:01 (20068) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/05 09:10:36 (20103) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:11:03 (20114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:12:02 (20131) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/05 09:12:02 (20131) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/05 09:12:02 (20131) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/05 09:17:03 (20144) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/05 09:17:03 (20144) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/05 09:17:03 (20144) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/05 09:19:43 (20159) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:22:04 (20172) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/05 09:22:04 (20172) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/05 09:22:04 (20172) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/05 09:27:05 (20234) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/05 09:27:05 (20234) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/05 09:27:05 (20234) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/05 09:28:31 (20251) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:30:25 (20279) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:32:06 (20291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/05 09:32:06 (20291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/05 09:32:06 (20291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/05 09:37:07 (20330) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/05 09:37:07 (20330) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/05 09:37:07 (20330) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/05 09:40:45 (20374) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:40:47 (20380) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:42:09 (20400) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/05 09:42:09 (20400) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/05 09:42:09 (20400) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/05 09:47:09 (20406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/05 09:47:09 (20406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/05 09:47:09 (20406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/05 09:50:46 (20426) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 09:52:10 (20434) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/05 09:52:10 (20434) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/05 09:52:10 (20434) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/05 09:57:11 (20478) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/05 09:57:11 (20478) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/05 09:57:11 (20478) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/05 10:00:01 (20520) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:01:21 (20607) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:02:12 (20614) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/05 10:02:12 (20614) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/05 10:02:12 (20614) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/05 10:07:13 (20694) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/05 10:07:13 (20694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/05 10:07:13 (20694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/05 10:10:39 (20736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:11:32 (20747) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:12:14 (20764) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/05 10:12:14 (20764) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/05 10:12:14 (20764) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/05 10:17:15 (20773) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/05 10:17:15 (20773) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/05 10:17:15 (20773) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/05 10:20:13 (20834) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:22:16 (20842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/05 10:22:16 (20842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/05 10:22:16 (20842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/05 10:27:17 (20854) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/05 10:27:17 (20854) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/05 10:27:17 (20854) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/05 10:31:10 (21028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:32:18 (21083) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/05 10:32:18 (21083) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/05 10:32:18 (21083) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/05 10:32:39 (21084) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:37:19 (21130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/05 10:37:19 (21130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/05 10:37:19 (21130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/05 10:41:21 (21237) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:42:20 (21245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/05 10:42:20 (21245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/05 10:42:20 (21245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/05 10:42:43 (21247) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:47:21 (21268) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/05 10:47:21 (21268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/05 10:47:21 (21268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/05 10:50:57 (21287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 10:52:22 (21295) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/05 10:52:22 (21295) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/05 10:52:22 (21295) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/05 10:57:23 (21305) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/05 10:57:23 (21305) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/05 10:57:23 (21305) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/05 11:00:59 (21425) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:01:26 (21467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:02:24 (21474) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/05 11:02:24 (21474) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/05 11:02:24 (21474) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/05 11:07:25 (21517) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/05 11:07:25 (21517) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/05 11:07:25 (21517) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/05 11:10:23 (21552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:11:36 (21562) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:12:26 (21569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/05 11:12:26 (21569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/05 11:12:26 (21569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/05 11:17:27 (21590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/05 11:17:27 (21590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/05 11:17:27 (21590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/05 11:21:13 (21610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:22:28 (21617) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/05 11:22:28 (21617) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/05 11:22:28 (21617) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/05 11:27:29 (21627) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/05 11:27:29 (21627) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/05 11:27:29 (21627) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/05 11:30:04 (21650) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:30:13 (21670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:32:30 (21736) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/05 11:32:30 (21736) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/05 11:32:30 (21736) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/05 11:37:32 (21779) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/05 11:37:32 (21779) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/05 11:37:32 (21779) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/05 11:41:02 (21921) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:42:32 (21973) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/05 11:42:32 (21973) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/05 11:42:32 (21973) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/05 11:47:33 (22111) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/05 11:47:33 (22111) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/05 11:47:33 (22111) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/05 11:50:27 (22147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 11:52:34 (22155) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/05 11:52:34 (22155) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/05 11:52:34 (22155) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/05 11:57:35 (22166) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/05 11:57:35 (22166) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/05 11:57:35 (22166) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/05 12:00:38 (22249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 12:02:36 (22311) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/05 12:02:36 (22311) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/05 12:02:36 (22311) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/05 12:07:37 (22372) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/05 12:07:37 (22372) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/05 12:07:37 (22372) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/05 12:10:47 (22474) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 12:12:38 (22484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/05 12:12:38 (22484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/05 12:12:38 (22484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/05 12:17:39 (22546) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/05 12:17:39 (22546) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/05 12:17:39 (22546) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/05 12:20:16 (22583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 12:22:40 (22591) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/05 12:22:40 (22591) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/05 12:22:40 (22591) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/05 12:27:41 (22604) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/05 12:27:41 (22604) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/05 12:27:41 (22604) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/05 12:31:09 (22638) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 12:32:42 (22660) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/05 12:32:42 (22660) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/05 12:32:42 (22660) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/05 12:37:43 (22822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/05 12:37:43 (22822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/05 12:37:43 (22822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/05 12:40:14 (22867) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 12:42:44 (22919) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/05 12:42:44 (22919) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/05 12:42:44 (22919) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/05 12:47:45 (22934) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/05 12:47:45 (22934) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/05 12:47:45 (22934) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/05 12:49:52 (22963) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 12:52:46 (22976) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/05 12:52:46 (22976) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/05 12:52:46 (22976) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/05 12:57:47 (22989) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/05 12:57:47 (22989) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/05 12:57:47 (22989) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/05 13:00:33 (23067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 13:02:48 (23100) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/05 13:02:48 (23100) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/05 13:02:48 (23100) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/05 13:07:49 (23198) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/05 13:07:49 (23198) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/05 13:07:49 (23198) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/05 13:10:43 (23239) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 13:12:50 (23251) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/05 13:12:50 (23251) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/05 13:12:50 (23251) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/05 13:17:52 (23269) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/05 13:17:52 (23269) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/05 13:17:52 (23269) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/05 13:21:25 (23301) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 13:22:52 (23313) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/05 13:22:52 (23313) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/05 13:22:52 (23313) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/05 13:27:53 (23324) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/05 13:27:53 (23324) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/05 13:27:53 (23324) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/05 13:30:51 (23358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 13:32:54 (23366) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/05 13:32:54 (23366) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/05 13:32:54 (23366) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/05 13:37:55 (23442) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/05 13:37:55 (23442) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/05 13:37:55 (23442) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/05 13:41:18 (23512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 13:42:56 (23519) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/05 13:42:56 (23519) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/05 13:42:56 (23519) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/05 13:47:57 (23530) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/05 13:47:57 (23530) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/05 13:47:57 (23530) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/05 13:52:03 (23565) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 13:52:58 (23576) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/05 13:52:58 (23576) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/05 13:52:58 (23576) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/05 13:57:59 (23586) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/05 13:57:59 (23586) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/05 13:57:59 (23586) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/05 14:01:58 (23689) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 14:03:00 (23696) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/05 14:03:00 (23696) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/05 14:03:00 (23696) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/05 14:08:01 (23767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/05 14:08:01 (23767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/05 14:08:01 (23767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/05 14:12:28 (23839) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 14:13:02 (23845) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/05 14:13:02 (23845) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/05 14:13:02 (23845) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/05 14:18:03 (23858) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/05 14:18:03 (23858) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/05 14:18:03 (23858) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/05 14:22:27 (23897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 14:23:04 (23903) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/05 14:23:04 (23903) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/05 14:23:04 (23903) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/05 14:28:05 (23912) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/05 14:28:05 (23912) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/05 14:28:05 (23912) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/05 14:32:45 (23952) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 14:33:06 (23958) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/05 14:33:06 (23958) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/05 14:33:06 (23958) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/05 14:38:07 (24014) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/05 14:38:07 (24014) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/05 14:38:07 (24014) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/05 14:42:00 (24101) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 14:43:08 (24108) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/05 14:43:08 (24108) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/05 14:43:08 (24108) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/05 14:48:09 (24119) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/05 14:48:09 (24119) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/05 14:48:09 (24119) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/05 14:51:58 (24158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 14:53:10 (24165) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/05 14:53:10 (24165) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/05 14:53:10 (24165) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/05 14:58:11 (24179) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/05 14:58:11 (24179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/05 14:58:11 (24179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/05 15:01:47 (24322) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 15:03:12 (24333) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/05 15:03:12 (24333) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/05 15:03:12 (24333) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/05 15:08:14 (24353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/05 15:08:14 (24353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/05 15:08:14 (24353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/05 15:11:54 (24496) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 15:13:14 (24509) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/05 15:13:14 (24509) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/05 15:13:14 (24509) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/05 15:18:15 (24526) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/05 15:18:15 (24526) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/05 15:18:15 (24526) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/05 15:21:14 (24556) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 15:23:16 (24592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/05 15:23:16 (24592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/05 15:23:16 (24592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/05 15:28:17 (24605) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/05 15:28:17 (24605) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/05 15:28:17 (24605) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/05 15:31:13 (24637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 15:33:18 (24648) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/05 15:33:18 (24648) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/05 15:33:18 (24648) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/05 15:38:19 (24659) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/05 15:38:19 (24659) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/05 15:38:19 (24659) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/05 15:41:11 (24818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 15:43:20 (24850) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/05 15:43:20 (24850) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/05 15:43:20 (24850) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/05 15:48:21 (24865) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/05 15:48:21 (24865) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/05 15:48:21 (24865) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/05 15:51:44 (24896) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 15:53:22 (24904) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/05 15:53:22 (24904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/05 15:53:22 (24904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/05 15:58:23 (24923) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/05 15:58:23 (24923) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/05 15:58:23 (24923) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/05 16:02:12 (25018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 16:03:24 (25026) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/05 16:03:24 (25026) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/05 16:03:24 (25026) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/05 16:08:25 (25037) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/05 16:08:25 (25037) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/05 16:08:25 (25037) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/05 16:13:08 (25155) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 16:13:26 (25162) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/05 16:13:26 (25162) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/05 16:13:26 (25162) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/05 16:18:27 (25199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/05 16:18:27 (25199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/05 16:18:27 (25199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/05 16:22:29 (25231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 16:23:28 (25238) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/05 16:23:28 (25238) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/05 16:23:28 (25238) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/05 16:28:29 (25254) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/05 16:28:29 (25254) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/05 16:28:29 (25254) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/05 16:32:43 (25288) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 16:33:30 (25295) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/05 16:33:30 (25295) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/05 16:33:30 (25295) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/05 16:38:32 (25370) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/05 16:38:32 (25370) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/05 16:38:32 (25370) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/05 16:42:19 (25464) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 16:43:32 (25499) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/05 16:43:32 (25499) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/05 16:43:32 (25499) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/05 16:48:33 (25531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/05 16:48:33 (25531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/05 16:48:33 (25531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/05 16:51:29 (25562) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 16:53:34 (25577) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/05 16:53:34 (25577) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/05 16:53:34 (25577) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/05 16:58:35 (25586) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/05 16:58:35 (25586) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/05 16:58:35 (25586) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/05 17:00:42 (25661) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 17:03:36 (25698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/05 17:03:36 (25698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/05 17:03:36 (25698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/05 17:08:37 (25707) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/05 17:08:37 (25707) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/05 17:08:37 (25707) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/05 17:09:52 (25738) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 17:13:38 (25812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/05 17:13:38 (25812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/05 17:13:38 (25812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/05 17:18:39 (25863) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/05 17:18:39 (25863) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/05 17:18:39 (25863) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/05 17:19:52 (25888) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 17:23:40 (25913) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/05 17:23:40 (25913) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/05 17:23:40 (25913) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/05 17:28:41 (25923) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/05 17:28:41 (25923) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/05 17:28:41 (25923) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/05 17:30:04 (25952) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 17:33:42 (25962) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/05 17:33:42 (25962) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/05 17:33:42 (25962) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/05 17:38:43 (25978) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/05 17:38:43 (25978) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/05 17:38:43 (25978) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/05 17:39:54 (26012) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 17:43:44 (26041) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/05 17:43:44 (26041) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/05 17:43:44 (26041) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/05 17:48:45 (26132) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/05 17:48:45 (26132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/05 17:48:45 (26132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/05 17:50:41 (26160) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 17:53:46 (26173) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/05 17:53:46 (26173) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/05 17:53:46 (26173) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/05 17:58:47 (26186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/05 17:58:47 (26186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/05 17:58:47 (26186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/05 18:00:29 (26260) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 18:03:48 (26296) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/05 18:03:48 (26296) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/05 18:03:48 (26296) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/05 18:08:49 (26308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/05 18:08:49 (26308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/05 18:08:49 (26308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/05 18:11:04 (26358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 18:13:50 (26367) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/05 18:13:50 (26367) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/05 18:13:50 (26367) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/05 18:18:51 (26460) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/05 18:18:51 (26460) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/05 18:18:51 (26460) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/05 18:21:18 (26494) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 18:23:52 (26507) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/05 18:23:52 (26507) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/05 18:23:52 (26507) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/05 18:28:54 (26522) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/05 18:28:54 (26522) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/05 18:28:54 (26522) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/05 18:31:58 (26554) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 18:33:54 (26565) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/05 18:33:54 (26565) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/05 18:33:54 (26565) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/05 18:38:55 (26579) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/05 18:38:55 (26579) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/05 18:38:55 (26579) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/05 18:42:07 (26628) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 18:43:56 (26636) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/05 18:43:56 (26636) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/05 18:43:56 (26636) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/05 18:48:57 (26714) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/05 18:48:57 (26714) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/05 18:48:57 (26714) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/05 18:52:12 (26758) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 18:53:58 (26770) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/05 18:53:58 (26770) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/05 18:53:58 (26770) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/05 18:58:59 (26786) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/05 18:58:59 (26786) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/05 18:58:59 (26786) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/05 19:02:36 (26876) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 19:04:00 (26887) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/05 19:04:00 (26887) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/05 19:04:00 (26887) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/05 19:09:01 (26904) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/05 19:09:01 (26904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/05 19:09:01 (26904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/05 19:12:28 (26957) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 19:14:02 (26967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/05 19:14:02 (26967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/05 19:14:02 (26967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/05 19:19:03 (27025) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/05 19:19:03 (27025) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/05 19:19:03 (27025) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/05 19:22:34 (27091) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 19:24:04 (27102) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/05 19:24:04 (27102) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/05 19:24:04 (27102) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/05 19:29:05 (27121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/05 19:29:05 (27121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/05 19:29:05 (27121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/05 19:32:39 (27155) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 19:34:06 (27162) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/05 19:34:06 (27162) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/05 19:34:06 (27162) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/05 19:39:07 (27180) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/05 19:39:07 (27180) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/05 19:39:07 (27180) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/05 19:41:43 (27229) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 19:44:08 (27237) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/05 19:44:08 (27237) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/05 19:44:08 (27237) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/05 19:49:09 (27282) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/05 19:49:09 (27282) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/05 19:49:09 (27282) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/05 19:51:01 (27340) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 19:54:10 (27370) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/05 19:54:10 (27370) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/05 19:54:10 (27370) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/05 19:59:11 (27386) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/05 19:59:11 (27386) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/05 19:59:11 (27386) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/05 20:00:45 (27457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 20:04:12 (27485) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/05 20:04:12 (27485) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/05 20:04:12 (27485) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/05 20:09:13 (27500) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/05 20:09:13 (27500) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/05 20:09:13 (27500) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/05 20:10:08 (27535) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 20:14:14 (27566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/05 20:14:14 (27566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/05 20:14:14 (27566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/05 20:19:15 (27602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/05 20:19:15 (27602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/05 20:19:15 (27602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/05 20:19:20 (27603) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 20:24:17 (27697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/05 20:24:17 (27697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/05 20:24:17 (27697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/05 20:28:57 (27735) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 20:29:18 (27741) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/05 20:29:18 (27741) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/05 20:29:18 (27741) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/05 20:34:19 (27760) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/05 20:34:19 (27760) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/05 20:34:19 (27760) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/05 20:38:27 (27791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 20:39:20 (27798) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/05 20:39:20 (27798) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/05 20:39:20 (27798) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/05 20:44:21 (27835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/05 20:44:21 (27835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/05 20:44:21 (27835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/05 20:48:20 (27865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 20:49:22 (27872) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/05 20:49:22 (27872) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/05 20:49:22 (27872) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/05 20:54:23 (27950) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/05 20:54:23 (27950) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/05 20:54:23 (27950) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/05 20:58:39 (28000) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 20:59:24 (28017) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/05 20:59:24 (28017) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/05 20:59:24 (28017) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/05 21:04:25 (28094) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/05 21:04:25 (28094) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/05 21:04:25 (28094) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/05 21:09:05 (28129) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 21:09:26 (28135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/05 21:09:26 (28135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/05 21:09:26 (28135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/05 21:14:27 (28173) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/05 21:14:27 (28173) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/05 21:14:27 (28173) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/05 21:19:07 (28209) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 21:19:28 (28215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/05 21:19:28 (28215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/05 21:19:28 (28215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/05 21:24:29 (28285) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/05 21:24:29 (28285) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/05 21:24:29 (28285) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/05 21:28:38 (28341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 21:29:30 (28348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/05 21:29:30 (28348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/05 21:29:30 (28348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/05 21:34:31 (28369) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/05 21:34:31 (28369) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/05 21:34:31 (28369) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/05 21:38:43 (28404) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 21:39:32 (28410) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/05 21:39:32 (28410) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/05 21:39:32 (28410) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/05 21:44:33 (28444) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/05 21:44:33 (28444) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/05 21:44:33 (28444) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/05 21:49:00 (28478) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 21:49:34 (28484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/05 21:49:34 (28484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/05 21:49:34 (28484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/05 21:54:35 (28539) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/05 21:54:35 (28539) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/05 21:54:35 (28539) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/05 21:59:29 (28611) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 21:59:36 (28617) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/05 21:59:36 (28617) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/05 21:59:36 (28617) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/05 22:04:37 (28692) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/05 22:04:37 (28692) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/05 22:04:37 (28692) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/05 22:09:38 (28708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/05 22:09:38 (28708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/05 22:09:38 (28708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/05 22:10:05 (28734) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 22:14:39 (28767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/05 22:14:39 (28767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/05 22:14:39 (28767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/05 22:19:10 (28808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 22:19:41 (28814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/05 22:19:41 (28814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/05 22:19:41 (28814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/05 22:24:41 (28831) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/05 22:24:41 (28831) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/05 22:24:41 (28831) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/05 22:29:42 (28945) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/05 22:29:42 (28945) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/05 22:29:42 (28945) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/05 22:29:56 (28947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 22:34:43 (28966) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/05 22:34:43 (28966) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/05 22:34:43 (28966) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/05 22:39:44 (28985) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/05 22:39:44 (28985) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/05 22:39:44 (28985) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/05 22:40:53 (29020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 22:44:45 (29044) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/05 22:44:45 (29044) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/05 22:44:45 (29044) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/05 22:49:46 (29059) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/05 22:49:46 (29059) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/05 22:49:46 (29059) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/05 22:51:21 (29086) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 22:54:47 (29100) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/05 22:54:47 (29100) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/05 22:54:47 (29100) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/05 22:59:48 (29191) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/05 22:59:48 (29191) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/05 22:59:48 (29191) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/05 23:00:23 (29260) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 23:04:49 (29312) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/05 23:04:49 (29312) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/05 23:04:49 (29312) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/05 23:09:50 (29354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/05 23:09:50 (29354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/05 23:09:50 (29354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/05 23:10:03 (29359) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 23:14:51 (29394) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/05 23:14:51 (29394) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/05 23:14:51 (29394) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/05 23:19:45 (29436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 23:19:52 (29442) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/05 23:19:52 (29442) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/05 23:19:52 (29442) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/05 23:24:53 (29484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/05 23:24:53 (29484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/05 23:24:53 (29484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/05 23:29:54 (29555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/05 23:29:54 (29555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/05 23:29:54 (29555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/05 23:30:12 (29580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 23:34:55 (29615) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/05 23:34:55 (29615) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/05 23:34:55 (29615) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/05 23:39:56 (29673) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/05 23:39:56 (29673) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/05 23:39:56 (29673) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/05 23:40:00 (29674) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 23:44:57 (29748) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/05 23:44:57 (29748) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/05 23:44:57 (29748) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/05 23:49:58 (29761) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/05 23:49:58 (29761) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/05 23:49:58 (29761) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/05 23:50:38 (29786) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/05 23:54:59 (29813) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/05 23:54:59 (29813) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/05 23:54:59 (29813) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/06 00:00:00 (29879) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/06 00:00:00 (29879) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/06 00:00:00 (29879) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/06 00:00:50 (29954) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 00:05:01 (30014) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/06 00:05:01 (30014) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/06 00:05:01 (30014) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/06 00:10:02 (30024) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/06 00:10:02 (30024) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/06 00:10:02 (30024) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/06 00:10:38 (30048) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 00:15:03 (30090) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/06 00:15:03 (30090) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/06 00:15:03 (30090) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/06 00:20:05 (30111) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/06 00:20:05 (30111) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/06 00:20:05 (30111) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/06 00:21:09 (30133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 00:25:05 (30155) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/06 00:25:05 (30155) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/06 00:25:05 (30155) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/06 00:30:06 (30204) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/06 00:30:06 (30204) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/06 00:30:06 (30204) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/06 00:30:23 (30225) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 00:35:07 (30287) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/06 00:35:07 (30287) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/06 00:35:07 (30287) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/06 00:39:36 (30312) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 00:40:08 (30323) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/06 00:40:08 (30323) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/06 00:40:08 (30323) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/06 00:45:09 (30361) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/06 00:45:09 (30361) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/06 00:45:09 (30361) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/06 00:49:55 (30391) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 00:50:10 (30401) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/06 00:50:10 (30401) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/06 00:50:10 (30401) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/06 00:55:11 (30413) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/06 00:55:11 (30413) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/06 00:55:11 (30413) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/06 00:59:01 (30441) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 01:00:12 (30499) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/06 01:00:12 (30499) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/06 01:00:12 (30499) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/06 01:05:24 (30671) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/06 01:05:24 (30671) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/06 01:05:24 (30671) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/06 01:06:11 (30761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 01:10:25 (30785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/06 01:10:25 (30785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/06 01:10:25 (30785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/06 01:15:26 (30821) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/06 01:15:26 (30821) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/06 01:15:26 (30821) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/06 01:15:55 (30843) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 01:20:27 (30860) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/06 01:20:27 (30860) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/06 01:20:27 (30860) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/06 01:25:19 (30886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 01:25:28 (30897) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/06 01:25:28 (30897) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/06 01:25:28 (30897) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/06 01:30:29 (30910) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/06 01:30:29 (30910) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/06 01:30:29 (30910) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/06 01:35:30 (31005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/06 01:35:30 (31005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/06 01:35:30 (31005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/06 01:36:11 (31030) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 01:40:31 (31051) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/06 01:40:31 (31051) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/06 01:40:31 (31051) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/06 01:45:24 (31104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 01:45:32 (31110) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/06 01:45:32 (31110) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/06 01:45:32 (31110) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/06 01:50:33 (31122) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/06 01:50:33 (31122) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/06 01:50:33 (31122) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/06 01:54:26 (31150) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 01:55:34 (31160) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/06 01:55:34 (31160) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/06 01:55:34 (31160) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/06 02:00:35 (31223) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/06 02:00:35 (31223) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/06 02:00:35 (31223) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/06 02:03:45 (31309) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 02:05:36 (31351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/06 02:05:36 (31351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/06 02:05:36 (31351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/06 02:10:37 (31388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/06 02:10:37 (31388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/06 02:10:37 (31388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/06 02:13:44 (31433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 02:15:38 (31449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/06 02:15:38 (31449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/06 02:15:38 (31449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/06 02:20:39 (31463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/06 02:20:39 (31463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/06 02:20:39 (31463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/06 02:23:41 (31487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 02:25:40 (31498) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/06 02:25:40 (31498) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/06 02:25:40 (31498) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/06 02:30:41 (31574) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/06 02:30:41 (31574) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/06 02:30:41 (31574) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/06 02:33:59 (31607) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 02:35:42 (31676) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/06 02:35:42 (31676) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/06 02:35:42 (31676) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/06 02:40:43 (31716) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/06 02:40:43 (31716) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/06 02:40:43 (31716) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/06 02:43:05 (31761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 02:45:44 (31771) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/06 02:45:44 (31771) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/06 02:45:44 (31771) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/06 02:50:45 (31787) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/06 02:50:45 (31787) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/06 02:50:45 (31787) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/06 02:53:02 (31813) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 02:55:46 (31823) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/06 02:55:46 (31823) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/06 02:55:46 (31823) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/06 03:00:47 (31881) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/06 03:00:47 (31881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/06 03:00:47 (31881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/06 03:03:36 (31929) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 03:05:48 (31974) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/06 03:05:48 (31974) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/06 03:05:48 (31974) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/06 03:10:49 (32045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/06 03:10:49 (32045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/06 03:10:49 (32045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/06 03:13:44 (32092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 03:15:50 (32105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/06 03:15:50 (32105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/06 03:15:50 (32105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/06 03:20:51 (32120) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/06 03:20:51 (32120) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/06 03:20:51 (32120) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/06 03:23:46 (32147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 03:25:52 (32157) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/06 03:25:52 (32157) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/06 03:25:52 (32157) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/06 03:30:53 (32182) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/06 03:30:53 (32182) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/06 03:30:53 (32182) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/06 03:34:11 (32211) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 03:35:54 (32230) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/06 03:35:54 (32230) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/06 03:35:54 (32230) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/06 03:40:55 (32334) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/06 03:40:55 (32334) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/06 03:40:55 (32334) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/06 03:43:24 (32379) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 03:45:56 (32392) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/06 03:45:56 (32392) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/06 03:45:56 (32392) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/06 03:50:57 (32406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/06 03:50:57 (32406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/06 03:50:57 (32406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/06 03:54:04 (32433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 03:55:58 (32445) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/06 03:55:58 (32445) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/06 03:55:58 (32445) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/06 04:00:59 (32530) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/06 04:00:59 (32530) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/06 04:00:59 (32530) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/06 04:04:20 (32580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 04:06:00 (32602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/06 04:06:00 (32602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/06 04:06:00 (32602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/06 04:11:01 (32697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/06 04:11:01 (32697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/06 04:11:01 (32697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/06 04:13:25 (32727) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 04:16:02 (319) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/06 04:16:02 (319) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/06 04:16:02 (319) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/06 04:21:03 (338) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/06 04:21:03 (338) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/06 04:21:03 (338) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/06 04:24:13 (362) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 04:26:04 (373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/06 04:26:04 (373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/06 04:26:04 (373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/06 04:31:05 (388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/06 04:31:05 (388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/06 04:31:05 (388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/06 04:33:41 (670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 04:36:06 (688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/06 04:36:06 (688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/06 04:36:06 (688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/06 04:41:07 (769) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/06 04:41:07 (769) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/06 04:41:07 (769) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/06 04:44:42 (832) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 04:46:08 (840) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/06 04:46:08 (840) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/06 04:46:08 (840) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/06 04:51:09 (859) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/06 04:51:09 (859) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/06 04:51:09 (859) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/06 04:55:15 (886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 04:56:10 (893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/06 04:56:10 (893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/06 04:56:10 (893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/06 05:01:11 (972) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/06 05:01:11 (972) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/06 05:01:11 (972) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/06 05:05:41 (997) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 05:06:12 (1004) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/06 05:06:12 (1004) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/06 05:06:12 (1004) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/06 05:11:13 (1076) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/06 05:11:13 (1076) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/06 05:11:13 (1076) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/06 05:14:59 (1170) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 05:16:14 (1179) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/06 05:16:14 (1179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/06 05:16:14 (1179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/06 05:21:15 (1204) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/06 05:21:15 (1204) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/06 05:21:15 (1204) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/06 05:25:18 (1229) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 05:26:16 (1243) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/06 05:26:16 (1243) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/06 05:26:16 (1243) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/06 05:31:17 (1265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/06 05:31:17 (1265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/06 05:31:17 (1265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/06 05:34:45 (1293) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 05:36:18 (1301) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/06 05:36:18 (1301) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/06 05:36:18 (1301) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/06 05:41:19 (1331) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/06 05:41:19 (1331) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/06 05:41:19 (1331) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/06 05:44:40 (1455) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 05:46:20 (1472) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/06 05:46:20 (1472) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/06 05:46:20 (1472) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/06 05:51:21 (1488) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/06 05:51:21 (1488) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/06 05:51:21 (1488) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/06 05:53:50 (1515) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 05:56:22 (1533) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/06 05:56:22 (1533) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/06 05:56:22 (1533) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/06 06:01:23 (1611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/06 06:01:23 (1611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/06 06:01:23 (1611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/06 06:04:29 (1639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 06:06:24 (1650) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/06 06:06:24 (1650) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/06 06:06:24 (1650) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/06 06:11:25 (1681) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/06 06:11:25 (1681) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/06 06:11:25 (1681) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/06 06:13:43 (1755) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 06:16:26 (1815) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/06 06:16:26 (1815) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/06 06:16:26 (1815) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/06 06:21:28 (1843) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/06 06:21:28 (1843) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/06 06:21:28 (1843) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/06 06:23:12 (1870) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 06:26:28 (1882) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/06 06:26:28 (1882) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/06 06:26:28 (1882) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/06 06:31:29 (1897) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/06 06:31:29 (1897) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/06 06:31:29 (1897) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/06 06:33:14 (1932) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 06:36:30 (1952) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/06 06:36:30 (1952) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/06 06:36:30 (1952) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/06 06:41:31 (1969) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/06 06:41:31 (1969) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/06 06:41:31 (1969) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/06 06:43:54 (2032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 06:46:32 (2096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/06 06:46:32 (2096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/06 06:46:32 (2096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/06 06:51:33 (2133) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/06 06:51:33 (2133) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/06 06:51:33 (2133) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/06 06:53:27 (2162) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 06:56:34 (2176) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/06 06:56:34 (2176) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/06 06:56:34 (2176) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/06 07:01:35 (2263) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/06 07:01:35 (2263) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/06 07:01:35 (2263) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/06 07:04:16 (2311) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 07:06:36 (2342) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/06 07:06:36 (2342) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/06 07:06:36 (2342) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/06 07:11:37 (2358) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/06 07:11:37 (2358) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/06 07:11:37 (2358) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/06 07:15:10 (2430) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 07:16:38 (2470) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/06 07:16:38 (2470) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/06 07:16:38 (2470) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/06 07:21:39 (2506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/06 07:21:39 (2506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/06 07:21:39 (2506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/06 07:25:47 (2556) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 07:26:40 (2572) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/06 07:26:40 (2572) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/06 07:26:40 (2572) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/06 07:31:41 (2586) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/06 07:31:41 (2586) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/06 07:31:41 (2586) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/06 07:34:48 (2610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 07:36:42 (2630) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/06 07:36:42 (2630) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/06 07:36:42 (2630) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/06 07:41:43 (2690) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/06 07:41:43 (2690) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/06 07:41:43 (2690) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/06 07:44:06 (2741) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 07:46:44 (2803) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/06 07:46:44 (2803) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/06 07:46:44 (2803) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/06 07:51:45 (2852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/06 07:51:45 (2852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/06 07:51:45 (2852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/06 07:53:52 (2875) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 07:56:46 (2893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/06 07:56:46 (2893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/06 07:56:46 (2893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/06 08:01:47 (2964) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/06 08:01:47 (2964) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/06 08:01:47 (2964) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/06 08:03:02 (2990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 08:06:48 (3012) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/06 08:06:48 (3012) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/06 08:06:48 (3012) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/06 08:11:49 (3029) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/06 08:11:49 (3029) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/06 08:11:49 (3029) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/06 08:12:10 (3050) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 08:16:51 (3094) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/06 08:16:51 (3094) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/06 08:16:51 (3094) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/06 08:21:52 (3180) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/06 08:21:52 (3180) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/06 08:21:52 (3180) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/06 08:22:54 (3202) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 08:26:53 (3222) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/06 08:26:53 (3222) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/06 08:26:53 (3222) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/06 08:31:54 (3256) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/06 08:31:54 (3256) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/06 08:31:54 (3256) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/06 08:32:07 (3257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 08:36:55 (3277) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/06 08:36:55 (3277) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/06 08:36:55 (3277) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/06 08:41:56 (3316) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/06 08:41:56 (3316) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/06 08:41:56 (3316) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/06 08:41:59 (3317) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 08:46:57 (3356) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/06 08:46:57 (3356) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/06 08:46:57 (3356) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/06 08:51:58 (3449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/06 08:51:58 (3449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/06 08:51:58 (3449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/06 08:52:50 (3471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 08:56:59 (3483) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/06 08:56:59 (3483) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/06 08:56:59 (3483) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/06 09:02:00 (3561) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/06 09:02:00 (3561) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/06 09:02:00 (3561) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/06 09:02:51 (3583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 09:07:01 (3605) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/06 09:07:01 (3605) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/06 09:07:01 (3605) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/06 09:12:02 (3624) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/06 09:12:02 (3624) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/06 09:12:02 (3624) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/06 09:13:18 (3647) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 09:17:03 (3688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/06 09:17:03 (3688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/06 09:17:03 (3688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/06 09:22:04 (3763) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/06 09:22:04 (3763) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/06 09:22:04 (3763) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/06 09:23:34 (3806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 09:27:05 (3821) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/06 09:27:05 (3821) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/06 09:27:05 (3821) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/06 09:32:06 (3835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/06 09:32:06 (3835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/06 09:32:06 (3835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/06 09:33:03 (3857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 09:37:07 (3876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/06 09:37:07 (3876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/06 09:37:07 (3876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/06 09:42:08 (3893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/06 09:42:08 (3893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/06 09:42:08 (3893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/06 09:43:18 (3916) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 09:47:09 (3951) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/06 09:47:09 (3951) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/06 09:47:09 (3951) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/06 09:52:10 (4021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/06 09:52:10 (4021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/06 09:52:10 (4021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/06 09:54:11 (4065) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 09:57:11 (4079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/06 09:57:11 (4079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/06 09:57:11 (4079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/06 10:02:12 (4154) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/06 10:02:12 (4154) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/06 10:02:12 (4154) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/06 10:04:52 (4178) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 10:07:14 (4196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/06 10:07:14 (4196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/06 10:07:14 (4196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/06 10:12:15 (4217) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/06 10:12:15 (4217) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/06 10:12:15 (4217) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/06 10:14:09 (4240) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 10:17:16 (4280) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/06 10:17:16 (4280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/06 10:17:16 (4280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/06 10:22:17 (4335) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/06 10:22:17 (4335) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/06 10:22:17 (4335) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/06 10:25:01 (4398) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 10:27:18 (4415) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/06 10:27:18 (4415) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/06 10:27:18 (4415) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/06 10:32:19 (4429) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/06 10:32:19 (4429) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/06 10:32:19 (4429) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/06 10:35:54 (4459) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 10:37:20 (4470) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/06 10:37:20 (4470) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/06 10:37:20 (4470) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/06 10:42:21 (4568) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/06 10:42:21 (4568) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/06 10:42:21 (4568) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/06 10:45:34 (4607) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 10:47:22 (4627) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/06 10:47:22 (4627) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/06 10:47:22 (4627) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/06 10:52:23 (4644) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/06 10:52:23 (4644) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/06 10:52:23 (4644) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/06 10:55:45 (4731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 10:57:24 (4755) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/06 10:57:24 (4755) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/06 10:57:24 (4755) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/06 11:02:25 (4829) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/06 11:02:25 (4829) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/06 11:02:25 (4829) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/06 11:06:31 (4864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 11:07:26 (4871) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/06 11:07:26 (4871) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/06 11:07:26 (4871) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/06 11:12:27 (4892) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/06 11:12:27 (4892) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/06 11:12:27 (4892) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/06 11:17:21 (4946) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 11:17:28 (4953) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/06 11:17:28 (4953) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/06 11:17:28 (4953) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/06 11:22:29 (4967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/06 11:22:29 (4967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/06 11:22:29 (4967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/06 11:27:30 (5056) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/06 11:27:30 (5056) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/06 11:27:30 (5056) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/06 11:28:12 (5077) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 11:32:31 (5096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/06 11:32:31 (5096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/06 11:32:31 (5096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/06 11:37:20 (5131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 11:37:32 (5138) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/06 11:37:32 (5138) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/06 11:37:32 (5138) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/06 11:42:33 (5156) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/06 11:42:33 (5156) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/06 11:42:33 (5156) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/06 11:47:34 (5192) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/06 11:47:34 (5192) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/06 11:47:34 (5192) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/06 11:48:06 (5213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 11:52:35 (5231) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/06 11:52:35 (5231) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/06 11:52:35 (5231) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/06 11:57:36 (5324) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/06 11:57:36 (5324) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/06 11:57:36 (5324) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/06 11:57:39 (5325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 12:02:37 (5420) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/06 12:02:37 (5420) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/06 12:02:37 (5420) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/06 12:07:31 (5451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 12:07:39 (5460) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/06 12:07:39 (5460) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/06 12:07:39 (5460) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/06 12:12:40 (5484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/06 12:12:40 (5484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/06 12:12:40 (5484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/06 12:17:05 (5538) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 12:17:41 (5548) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/06 12:17:41 (5548) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/06 12:17:41 (5548) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/06 12:22:42 (5562) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/06 12:22:42 (5562) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/06 12:22:42 (5562) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/06 12:27:43 (5638) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/06 12:27:43 (5638) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/06 12:27:43 (5638) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/06 12:27:47 (5639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 12:32:44 (5694) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/06 12:32:44 (5694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/06 12:32:44 (5694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/06 12:37:45 (5709) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/06 12:37:45 (5709) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/06 12:37:45 (5709) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/06 12:38:38 (5731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 12:42:46 (5756) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/06 12:42:46 (5756) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/06 12:42:46 (5756) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/06 12:47:47 (5789) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/06 12:47:47 (5789) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/06 12:47:47 (5789) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/06 12:48:33 (5811) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 12:52:48 (5828) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/06 12:52:48 (5828) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/06 12:52:48 (5828) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/06 12:57:49 (5858) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/06 12:57:49 (5858) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/06 12:57:49 (5858) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/06 12:58:48 (5903) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 13:02:50 (6020) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/06 13:02:50 (6020) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/06 13:02:50 (6020) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/06 13:07:51 (6033) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/06 13:07:51 (6033) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/06 13:07:51 (6033) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/06 13:09:37 (6056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 13:12:52 (6078) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/06 13:12:52 (6078) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/06 13:12:52 (6078) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/06 13:17:53 (6114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/06 13:17:53 (6114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/06 13:17:53 (6114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/06 13:19:08 (6136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 13:22:54 (6160) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/06 13:22:54 (6160) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/06 13:22:54 (6160) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/06 13:27:55 (6172) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/06 13:27:55 (6172) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/06 13:27:55 (6172) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/06 13:29:45 (6230) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 13:32:56 (6293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/06 13:32:56 (6293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/06 13:32:56 (6293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/06 13:37:57 (6301) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/06 13:37:57 (6301) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/06 13:37:57 (6301) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/06 13:39:36 (6377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 13:42:58 (6394) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/06 13:42:58 (6394) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/06 13:42:58 (6394) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/06 13:47:59 (6426) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/06 13:47:59 (6426) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/06 13:47:59 (6426) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/06 13:48:59 (6448) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 13:53:00 (6471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/06 13:53:00 (6471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/06 13:53:00 (6471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/06 13:58:01 (6481) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/06 13:58:01 (6481) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/06 13:58:01 (6481) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/06 13:59:11 (6506) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 14:03:03 (6712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/06 14:03:03 (6712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/06 14:03:03 (6712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/06 14:08:03 (6778) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/06 14:08:03 (6778) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/06 14:08:03 (6778) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/06 14:09:17 (6807) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 14:13:04 (6825) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/06 14:13:04 (6825) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/06 14:13:04 (6825) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/06 14:18:05 (6856) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/06 14:18:05 (6856) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/06 14:18:05 (6856) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/06 14:19:20 (6886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 14:23:06 (6907) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/06 14:23:06 (6907) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/06 14:23:06 (6907) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/06 14:28:07 (6914) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/06 14:28:07 (6914) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/06 14:28:07 (6914) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/06 14:28:50 (6936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 14:33:08 (7013) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/06 14:33:08 (7013) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/06 14:33:08 (7013) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/06 14:38:09 (7050) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/06 14:38:09 (7050) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/06 14:38:09 (7050) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/06 14:38:46 (7074) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 14:43:10 (7094) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/06 14:43:10 (7094) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/06 14:43:10 (7094) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/06 14:48:11 (7143) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/06 14:48:11 (7143) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/06 14:48:11 (7143) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/06 14:48:28 (7144) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 14:53:12 (7171) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/06 14:53:12 (7171) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/06 14:53:12 (7171) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/06 14:58:13 (7197) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/06 14:58:13 (7197) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/06 14:58:13 (7197) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/06 14:58:31 (7201) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 15:03:14 (7326) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/06 15:03:14 (7326) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/06 15:03:14 (7326) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/06 15:08:15 (7398) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/06 15:08:15 (7398) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/06 15:08:15 (7398) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/06 15:09:23 (7422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 15:13:16 (7438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/06 15:13:16 (7438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/06 15:13:16 (7438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/06 15:18:17 (7477) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/06 15:18:17 (7477) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/06 15:18:17 (7477) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/06 15:19:19 (7504) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 15:23:18 (7521) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/06 15:23:18 (7521) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/06 15:23:18 (7521) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/06 15:28:19 (7554) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/06 15:28:19 (7554) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/06 15:28:19 (7554) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/06 15:28:47 (7576) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 15:33:20 (7606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/06 15:33:20 (7606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/06 15:33:20 (7606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/06 15:38:09 (7709) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 15:38:21 (7718) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/06 15:38:21 (7718) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/06 15:38:21 (7718) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/06 15:43:22 (7785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/06 15:43:22 (7785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/06 15:43:22 (7785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/06 15:47:35 (7842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 15:48:23 (7854) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/06 15:48:23 (7854) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/06 15:48:23 (7854) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/06 15:53:25 (7869) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/06 15:53:25 (7869) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/06 15:53:25 (7869) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/06 15:57:56 (7897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 15:58:25 (7906) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/06 15:58:25 (7906) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/06 15:58:25 (7906) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/06 16:03:26 (7984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/06 16:03:26 (7984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/06 16:03:26 (7984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/06 16:07:28 (8082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 16:08:27 (8105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/06 16:08:27 (8105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/06 16:08:27 (8105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/06 16:13:28 (8118) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/06 16:13:28 (8118) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/06 16:13:28 (8118) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/06 16:17:58 (8173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 16:18:29 (8179) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/06 16:18:29 (8179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/06 16:18:29 (8179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/06 16:23:30 (8202) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/06 16:23:30 (8202) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/06 16:23:30 (8202) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/06 16:27:13 (8230) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 16:28:31 (8239) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/06 16:28:31 (8239) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/06 16:28:31 (8239) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/06 16:33:32 (8260) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/06 16:33:32 (8260) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/06 16:33:32 (8260) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/06 16:36:42 (8326) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 16:38:33 (8361) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/06 16:38:33 (8361) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/06 16:38:33 (8361) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/06 16:43:34 (8389) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/06 16:43:34 (8389) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/06 16:43:34 (8389) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/06 16:46:17 (8413) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 16:48:35 (8447) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/06 16:48:35 (8447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/06 16:48:35 (8447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/06 16:53:36 (8463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/06 16:53:36 (8463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/06 16:53:36 (8463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/06 16:55:25 (8486) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 16:58:37 (8504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/06 16:58:37 (8504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/06 16:58:37 (8504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/06 17:03:38 (8579) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/06 17:03:38 (8579) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/06 17:03:38 (8579) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/06 17:06:07 (8616) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 17:08:39 (8677) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/06 17:08:39 (8677) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/06 17:08:39 (8677) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/06 17:13:40 (8712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/06 17:13:40 (8712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/06 17:13:40 (8712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/06 17:15:25 (8740) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 17:18:41 (8774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/06 17:18:41 (8774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/06 17:18:41 (8774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/06 17:23:42 (8793) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/06 17:23:42 (8793) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/06 17:23:42 (8793) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/06 17:24:48 (8822) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 17:28:43 (8835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/06 17:28:43 (8835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/06 17:28:43 (8835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/06 17:33:44 (8850) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/06 17:33:44 (8850) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/06 17:33:44 (8850) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/06 17:35:26 (8882) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 17:38:45 (8931) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/06 17:38:45 (8931) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/06 17:38:45 (8931) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/06 17:43:46 (8983) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/06 17:43:46 (8983) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/06 17:43:46 (8983) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/06 17:44:36 (9010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 17:48:47 (9046) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/06 17:48:47 (9046) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/06 17:48:47 (9046) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/06 17:53:48 (9061) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/06 17:53:48 (9061) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/06 17:53:48 (9061) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/06 17:54:08 (9084) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 17:58:49 (9101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/06 17:58:49 (9101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/06 17:58:49 (9101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/06 18:03:24 (9197) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:03:50 (9207) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/06 18:03:50 (9207) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/06 18:03:50 (9207) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/06 18:08:51 (9219) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/06 18:08:51 (9219) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/06 18:08:51 (9219) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/06 18:13:24 (9327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:13:52 (9337) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/06 18:13:52 (9337) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/06 18:13:52 (9337) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/06 18:18:53 (9371) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:18:53 (9371) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 18:18:53 (9371) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 18:18:53 (9371) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 18:23:54 (9410) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/06 18:23:54 (9410) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/06 18:23:54 (9410) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/06 18:23:58 (9411) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:28:55 (9432) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:28:55 (9432) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 18:28:55 (9432) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 18:28:55 (9432) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 18:33:56 (9454) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/06 18:33:56 (9454) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/06 18:33:56 (9454) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/06 18:34:18 (9475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:38:57 (9487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:38:57 (9487) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 18:38:57 (9487) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 18:38:57 (9487) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 18:43:58 (9589) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/06 18:43:58 (9589) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/06 18:43:58 (9589) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/06 18:44:35 (9610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:48:59 (9644) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/06 18:48:59 (9644) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/06 18:48:59 (9644) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/06 18:54:00 (9670) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/06 18:54:00 (9670) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/06 18:54:00 (9670) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/06 18:55:21 (9692) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 18:59:01 (9702) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/06 18:59:01 (9702) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/06 18:59:01 (9702) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/06 19:04:02 (9781) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/06 19:04:02 (9781) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/06 19:04:02 (9781) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/06 19:06:21 (9805) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:09:03 (9816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:09:03 (9816) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 19:09:03 (9816) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 19:09:03 (9816) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 19:14:04 (9894) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/06 19:14:04 (9894) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/06 19:14:04 (9894) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/06 19:16:17 (9936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:19:05 (9969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:19:06 (9969) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 19:19:06 (9969) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 19:19:06 (9969) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 19:24:06 (9995) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/06 19:24:06 (9995) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/06 19:24:06 (9995) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/06 19:27:08 (10023) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:29:08 (10035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:29:08 (10035) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 19:29:08 (10035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 19:29:08 (10035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 19:34:09 (10058) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/06 19:34:09 (10058) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/06 19:34:09 (10058) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/06 19:37:20 (10082) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:39:10 (10090) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:39:10 (10090) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 19:39:10 (10090) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 19:39:10 (10090) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 19:44:11 (10154) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/06 19:44:11 (10154) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/06 19:44:11 (10154) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/06 19:48:09 (10226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:49:12 (10245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/06 19:49:12 (10245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/06 19:49:12 (10245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/06 19:54:13 (10265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/06 19:54:13 (10265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/06 19:54:13 (10265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/06 19:57:42 (10291) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 19:59:14 (10299) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/06 19:59:14 (10299) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/06 19:59:14 (10299) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/06 20:04:15 (10379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/06 20:04:15 (10379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/06 20:04:15 (10379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/06 20:07:01 (10404) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 20:09:16 (10415) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/06 20:09:16 (10415) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/06 20:09:16 (10415) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/06 20:14:17 (10452) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/06 20:14:17 (10452) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/06 20:14:17 (10452) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/06 20:17:09 (10538) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 20:19:18 (10569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/06 20:19:18 (10569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/06 20:19:18 (10569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/06 20:24:19 (10592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/06 20:24:19 (10592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/06 20:24:19 (10592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/06 20:28:06 (10621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 20:29:20 (10628) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 20:29:20 (10628) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 20:29:20 (10628) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 20:29:20 (10628) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 20:34:21 (10645) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/06 20:34:21 (10645) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/06 20:34:21 (10645) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/06 20:38:16 (10675) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 20:39:22 (10682) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 20:39:22 (10682) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 20:39:22 (10682) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 20:39:22 (10682) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 20:44:23 (10708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/06 20:44:23 (10708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/06 20:44:23 (10708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/06 20:48:30 (10815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 20:49:24 (10837) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/06 20:49:24 (10837) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/06 20:49:24 (10837) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/06 20:54:25 (10856) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/06 20:54:25 (10856) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/06 20:54:25 (10856) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/06 20:58:01 (10887) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 20:59:26 (10894) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/06 20:59:26 (10894) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/06 20:59:26 (10894) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/06 21:04:27 (10971) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/06 21:04:27 (10971) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/06 21:04:27 (10971) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/06 21:07:23 (10998) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:09:28 (11006) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/06 21:09:28 (11006) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/06 21:09:28 (11006) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/06 21:14:29 (11026) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:14:30 (11026) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 21:14:30 (11026) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 21:14:30 (11026) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 21:17:42 (11097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:19:31 (11157) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/06 21:19:31 (11157) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/06 21:19:31 (11157) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/06 21:24:32 (11179) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:24:32 (11179) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 21:24:32 (11179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 21:24:32 (11179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 21:27:42 (11209) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:29:33 (11222) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/06 21:29:33 (11222) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/06 21:29:33 (11222) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/06 21:34:34 (11243) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:34:34 (11243) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 21:34:34 (11243) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 21:34:34 (11243) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 21:38:13 (11274) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:39:35 (11286) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/06 21:39:35 (11286) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/06 21:39:35 (11286) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/06 21:44:36 (11298) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/06 21:44:36 (11298) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/06 21:44:36 (11298) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/06 21:48:41 (11381) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:49:37 (11414) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/06 21:49:37 (11414) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/06 21:49:37 (11414) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/06 21:54:38 (11449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:54:38 (11449) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 21:54:38 (11449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 21:54:38 (11449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 21:58:58 (11487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 21:59:39 (11493) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/06 21:59:39 (11493) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/06 21:59:39 (11493) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/06 22:04:40 (11570) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:04:40 (11570) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 22:04:40 (11570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 22:04:40 (11570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 22:09:19 (11605) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:09:41 (11611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/06 22:09:41 (11611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/06 22:09:41 (11611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/06 22:14:42 (11625) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:14:42 (11625) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 22:14:42 (11625) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 22:14:42 (11625) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 22:19:28 (11727) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:19:43 (11733) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/06 22:19:43 (11733) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/06 22:19:43 (11733) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/06 22:24:44 (11785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/06 22:24:44 (11785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/06 22:24:44 (11785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/06 22:29:39 (11824) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:29:45 (11830) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/06 22:29:45 (11830) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/06 22:29:45 (11830) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/06 22:34:46 (11846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:34:46 (11846) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 22:34:46 (11846) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 22:34:46 (11846) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 22:39:47 (11865) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/06 22:39:47 (11865) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/06 22:39:47 (11865) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/06 22:40:18 (11891) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:44:48 (11904) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:44:48 (11904) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 22:44:48 (11904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 22:44:48 (11904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 22:49:42 (11963) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:49:49 (11969) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/06 22:49:49 (11969) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/06 22:49:49 (11969) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/06 22:54:50 (12050) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 22:54:50 (12050) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 22:54:50 (12050) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 22:54:50 (12050) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 22:59:51 (12068) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/06 22:59:51 (12068) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/06 22:59:51 (12068) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/06 23:00:12 (12138) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 23:04:52 (12170) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 23:04:53 (12170) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 23:04:53 (12170) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 23:04:53 (12170) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 23:09:53 (12213) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/06 23:09:54 (12213) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/06 23:09:54 (12213) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/06 23:10:36 (12239) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 23:14:54 (12252) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 23:14:54 (12252) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/06 23:14:54 (12252) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/06 23:14:54 (12252) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/06 23:19:55 (12314) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/06 23:19:55 (12314) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/06 23:19:55 (12314) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/06 23:20:09 (12322) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 23:24:56 (12412) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/06 23:24:56 (12412) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/06 23:24:56 (12412) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/06 23:29:57 (12452) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/06 23:29:57 (12452) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/06 23:29:57 (12452) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/06 23:30:57 (12484) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 23:34:58 (12497) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/06 23:34:58 (12497) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/06 23:34:58 (12497) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/06 23:39:59 (12514) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/06 23:39:59 (12514) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/06 23:39:59 (12514) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/06 23:40:53 (12540) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 23:45:00 (12604) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/06 23:45:00 (12604) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/06 23:45:00 (12604) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/06 23:50:01 (12652) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/06 23:50:01 (12652) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/06 23:50:01 (12652) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/06 23:50:57 (12678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/06 23:55:02 (12764) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/06 23:55:02 (12764) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/06 23:55:02 (12764) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/07 00:00:03 (12840) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/07 00:00:03 (12840) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/07 00:00:03 (12840) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/07 00:01:39 (12884) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 00:05:04 (12897) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/07 00:05:04 (12897) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/07 00:05:04 (12897) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/07 00:10:05 (12917) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/07 00:10:05 (12917) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/07 00:10:05 (12917) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/07 00:11:06 (12940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 00:15:06 (12953) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/07 00:15:06 (12953) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/07 00:15:06 (12953) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/07 00:20:07 (12994) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/07 00:20:07 (12994) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/07 00:20:07 (12994) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/07 00:21:23 (13016) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 00:25:08 (13089) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/07 00:25:08 (13089) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/07 00:25:08 (13089) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/07 00:30:09 (13136) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/07 00:30:09 (13136) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/07 00:30:09 (13136) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/07 00:31:46 (13158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 00:35:10 (13171) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/07 00:35:10 (13171) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/07 00:35:10 (13171) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/07 00:40:11 (13188) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/07 00:40:11 (13188) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/07 00:40:11 (13188) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/07 00:41:10 (13210) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 00:45:12 (13223) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/07 00:45:12 (13223) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/07 00:45:12 (13223) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/07 00:50:13 (13248) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/07 00:50:13 (13248) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/07 00:50:13 (13248) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/07 00:51:51 (13285) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 00:55:14 (13334) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/07 00:55:14 (13334) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/07 00:55:14 (13334) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/07 01:00:15 (13438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/07 01:00:15 (13438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/07 01:00:15 (13438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/07 01:01:46 (13483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 01:05:24 (13555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/07 01:05:24 (13555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/07 01:05:24 (13555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/07 01:05:44 (13636) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 01:10:26 (13665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/07 01:10:26 (13665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/07 01:10:26 (13665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/07 01:15:10 (13695) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 01:15:27 (13701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/07 01:15:27 (13701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/07 01:15:27 (13701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/07 01:20:28 (13744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/07 01:20:28 (13744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/07 01:20:28 (13744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/07 01:24:21 (13769) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 01:25:29 (13779) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/07 01:25:29 (13779) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/07 01:25:29 (13779) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/07 01:30:30 (13873) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/07 01:30:30 (13873) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/07 01:30:30 (13873) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/07 01:33:20 (13897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 01:35:31 (13915) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/07 01:35:31 (13915) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/07 01:35:31 (13915) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/07 01:40:32 (13938) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/07 01:40:32 (13938) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/07 01:40:32 (13938) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/07 01:43:02 (13961) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 01:45:33 (13973) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/07 01:45:33 (13973) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/07 01:45:33 (13973) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/07 01:50:34 (13997) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/07 01:50:34 (13997) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/07 01:50:34 (13997) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/07 01:53:56 (14033) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 01:55:35 (14041) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/07 01:55:35 (14041) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/07 01:55:35 (14041) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/07 02:00:36 (14186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/07 02:00:36 (14186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/07 02:00:36 (14186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/07 02:03:25 (14235) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 02:05:37 (14243) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/07 02:05:37 (14243) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/07 02:05:37 (14243) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/07 02:10:38 (14276) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/07 02:10:38 (14276) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/07 02:10:38 (14276) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/07 02:12:26 (14299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 02:15:39 (14311) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/07 02:15:39 (14311) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/07 02:15:39 (14311) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/07 02:20:40 (14341) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/07 02:20:40 (14341) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/07 02:20:40 (14341) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/07 02:23:25 (14377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 02:25:41 (14388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/07 02:25:41 (14388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/07 02:25:41 (14388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/07 02:30:42 (14525) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/07 02:30:42 (14525) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/07 02:30:42 (14525) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/07 02:33:02 (14564) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 02:35:43 (14584) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/07 02:35:43 (14584) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/07 02:35:43 (14584) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/07 02:40:44 (14600) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/07 02:40:44 (14600) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/07 02:40:44 (14600) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/07 02:43:44 (14625) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 02:45:45 (14641) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/07 02:45:45 (14641) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/07 02:45:45 (14641) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/07 02:50:46 (14660) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/07 02:50:46 (14660) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/07 02:50:46 (14660) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/07 02:53:46 (14696) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 02:55:47 (14711) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/07 02:55:47 (14711) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/07 02:55:47 (14711) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/07 03:00:48 (14832) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/07 03:00:48 (14832) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/07 03:00:48 (14832) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/07 03:04:32 (14913) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 03:05:49 (14920) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/07 03:05:49 (14920) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/07 03:05:49 (14920) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/07 03:10:51 (14938) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/07 03:10:51 (14938) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/07 03:10:51 (14938) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/07 03:13:41 (14965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 03:15:51 (14976) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/07 03:15:51 (14976) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/07 03:15:51 (14976) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/07 03:20:52 (15005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/07 03:20:52 (15005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/07 03:20:52 (15005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/07 03:24:30 (15048) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 03:25:53 (15055) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/07 03:25:53 (15055) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/07 03:25:53 (15055) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/07 03:30:54 (15106) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/07 03:30:54 (15106) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/07 03:30:54 (15106) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/07 03:34:19 (15176) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 03:35:55 (15188) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/07 03:35:55 (15188) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/07 03:35:55 (15188) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/07 03:40:56 (15206) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/07 03:40:56 (15206) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/07 03:40:56 (15206) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/07 03:43:16 (15231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 03:45:57 (15244) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/07 03:45:57 (15244) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/07 03:45:57 (15244) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/07 03:50:58 (15278) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/07 03:50:58 (15278) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/07 03:50:58 (15278) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/07 03:53:33 (15316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 03:55:59 (15327) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/07 03:55:59 (15327) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/07 03:55:59 (15327) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/07 04:01:00 (15387) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/07 04:01:00 (15387) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/07 04:01:00 (15387) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/07 04:03:31 (15487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 04:06:01 (15527) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/07 04:06:01 (15527) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/07 04:06:01 (15527) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/07 04:11:02 (15545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/07 04:11:02 (15545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/07 04:11:02 (15545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/07 04:14:26 (15576) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 04:16:03 (15583) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/07 04:16:03 (15583) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/07 04:16:03 (15583) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/07 04:21:04 (15607) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/07 04:21:04 (15607) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/07 04:21:04 (15607) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/07 04:25:01 (15654) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 04:26:05 (15661) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/07 04:26:05 (15661) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/07 04:26:05 (15661) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/07 04:31:06 (15673) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/07 04:31:06 (15673) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/07 04:31:06 (15673) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/07 04:34:17 (15762) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 04:36:07 (15822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/07 04:36:07 (15822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/07 04:36:07 (15822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/07 04:41:08 (15843) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/07 04:41:08 (15843) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/07 04:41:08 (15843) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/07 04:44:29 (15871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 04:46:09 (15881) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/07 04:46:09 (15881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/07 04:46:09 (15881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/07 04:51:10 (15903) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/07 04:51:10 (15903) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/07 04:51:10 (15903) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/07 04:54:43 (15971) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 04:56:11 (15980) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/07 04:56:11 (15980) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/07 04:56:11 (15980) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/07 05:01:12 (16062) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/07 05:01:12 (16062) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/07 05:01:12 (16062) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/07 05:05:11 (16136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 05:06:14 (16164) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/07 05:06:14 (16164) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/07 05:06:14 (16164) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/07 05:11:15 (18182) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/07 05:11:15 (18182) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/07 05:11:15 (18182) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/07 05:16:10 (18215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 05:16:16 (18221) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/07 05:16:16 (18221) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/07 05:16:16 (18221) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/07 05:21:17 (18245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/07 05:21:17 (18245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/07 05:21:17 (18245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/07 05:26:18 (18268) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/07 05:26:18 (18268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/07 05:26:18 (18268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/07 05:26:51 (18290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 05:31:19 (18314) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/07 05:31:19 (18314) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/07 05:31:19 (18314) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/07 05:36:20 (18392) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/07 05:36:20 (18392) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/07 05:36:20 (18392) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/07 05:36:22 (18394) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 05:41:21 (18450) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/07 05:41:21 (18450) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/07 05:41:21 (18450) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/07 05:46:22 (18463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/07 05:46:22 (18463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/07 05:46:22 (18463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/07 05:46:45 (18485) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 05:51:23 (18512) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/07 05:51:23 (18512) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/07 05:51:23 (18512) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/07 05:56:24 (18536) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/07 05:56:24 (18536) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/07 05:56:24 (18536) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/07 05:57:44 (18558) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 06:01:25 (18641) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/07 06:01:25 (18641) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/07 06:01:25 (18641) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/07 06:06:26 (18674) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/07 06:06:26 (18674) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/07 06:06:26 (18674) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/07 06:07:26 (18719) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 06:11:27 (18779) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/07 06:11:27 (18779) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/07 06:11:27 (18779) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/07 06:16:28 (18792) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/07 06:16:28 (18792) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/07 06:16:28 (18792) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/07 06:18:00 (18819) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 06:21:29 (18842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/07 06:21:29 (18842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/07 06:21:29 (18842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/07 06:26:30 (18865) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/07 06:26:30 (18865) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/07 06:26:30 (18865) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/07 06:28:07 (18890) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 06:31:31 (18909) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/07 06:31:31 (18909) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/07 06:31:31 (18909) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/07 06:36:32 (18936) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/07 06:36:32 (18936) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/07 06:36:32 (18936) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/07 06:38:37 (19001) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 06:41:33 (19051) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/07 06:41:33 (19051) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/07 06:41:33 (19051) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/07 06:46:34 (19063) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/07 06:46:34 (19063) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/07 06:46:34 (19063) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/07 06:48:19 (19088) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 06:51:35 (19114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/07 06:51:35 (19114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/07 06:51:35 (19114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/07 06:56:36 (19135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/07 06:56:36 (19135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/07 06:56:36 (19135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/07 06:58:43 (19162) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 07:01:38 (19236) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/07 07:01:38 (19236) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/07 07:01:38 (19236) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/07 07:06:38 (19256) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/07 07:06:38 (19256) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/07 07:06:38 (19256) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/07 07:09:23 (19347) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 07:11:39 (19385) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/07 07:11:39 (19385) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/07 07:11:39 (19385) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/07 07:16:40 (19413) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/07 07:16:40 (19413) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/07 07:16:40 (19413) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/07 07:20:05 (19445) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 07:21:41 (19465) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/07 07:21:41 (19465) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/07 07:21:41 (19465) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/07 07:26:42 (19489) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/07 07:26:42 (19489) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/07 07:26:42 (19489) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/07 07:30:50 (19545) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 07:31:43 (19552) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/07 07:31:43 (19552) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/07 07:31:43 (19552) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/07 07:36:44 (19572) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/07 07:36:44 (19572) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/07 07:36:44 (19572) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/07 07:41:36 (19671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 07:41:45 (19677) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/07 07:41:45 (19677) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/07 07:41:45 (19677) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/07 07:46:46 (19761) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/07 07:46:46 (19761) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/07 07:46:46 (19761) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/07 07:51:00 (19802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 07:51:47 (19818) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/07 07:51:47 (19818) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/07 07:51:47 (19818) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/07 07:56:48 (19839) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/07 07:56:48 (19839) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/07 07:56:48 (19839) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/07 08:01:17 (19937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 08:01:49 (19947) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/07 08:01:49 (19947) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/07 08:01:49 (19947) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/07 08:06:50 (19957) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/07 08:06:50 (19957) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/07 08:06:50 (19957) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/07 08:11:42 (20037) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 08:11:51 (20045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/07 08:11:51 (20045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/07 08:11:51 (20045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/07 08:16:52 (20095) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/07 08:16:52 (20095) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/07 08:16:52 (20095) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/07 08:21:18 (20131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 08:21:53 (20150) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/07 08:21:53 (20150) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/07 08:21:53 (20150) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/07 08:26:54 (20168) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/07 08:26:54 (20168) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/07 08:26:54 (20168) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/07 08:31:30 (20204) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 08:31:55 (20211) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/07 08:31:55 (20211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/07 08:31:55 (20211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/07 08:36:56 (20229) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/07 08:36:56 (20229) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/07 08:36:56 (20229) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/07 08:41:13 (20272) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 08:41:57 (20279) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/07 08:41:57 (20279) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/07 08:41:57 (20279) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/07 08:46:58 (20361) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/07 08:46:58 (20361) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/07 08:46:58 (20361) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/07 08:50:22 (20398) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 08:51:59 (20415) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/07 08:51:59 (20415) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/07 08:51:59 (20415) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/07 08:57:01 (20433) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/07 08:57:01 (20433) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/07 08:57:01 (20433) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/07 09:00:50 (20518) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 09:02:01 (20544) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/07 09:02:01 (20544) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/07 09:02:01 (20544) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/07 09:07:02 (20554) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/07 09:07:02 (20554) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/07 09:07:02 (20554) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/07 09:11:37 (20594) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 09:12:03 (20600) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/07 09:12:03 (20600) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/07 09:12:03 (20600) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/07 09:17:04 (20688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/07 09:17:04 (20688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/07 09:17:04 (20688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/07 09:20:58 (20726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 09:22:05 (20742) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/07 09:22:05 (20742) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/07 09:22:05 (20742) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/07 09:27:06 (20760) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/07 09:27:06 (20760) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/07 09:27:06 (20760) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/07 09:30:55 (20797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 09:32:07 (20808) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/07 09:32:07 (20808) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/07 09:32:07 (20808) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/07 09:37:08 (20822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/07 09:37:08 (20822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/07 09:37:08 (20822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/07 09:41:06 (20860) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 09:42:09 (20870) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/07 09:42:09 (20870) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/07 09:42:09 (20870) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/07 09:47:10 (20942) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/07 09:47:10 (20942) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/07 09:47:10 (20942) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/07 09:51:24 (20992) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 09:52:11 (21002) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/07 09:52:11 (21002) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/07 09:52:11 (21002) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/07 09:57:12 (21036) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/07 09:57:12 (21036) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/07 09:57:12 (21036) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/07 10:00:59 (21191) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 10:02:13 (21218) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/07 10:02:13 (21218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/07 10:02:13 (21218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/07 10:07:14 (21283) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/07 10:07:14 (21283) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/07 10:07:14 (21283) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/07 10:10:07 (21313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 10:12:15 (21329) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/07 10:12:15 (21329) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/07 10:12:15 (21329) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/07 10:17:16 (21398) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/07 10:17:16 (21398) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/07 10:17:16 (21398) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/07 10:20:41 (21451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 10:22:17 (21460) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/07 10:22:17 (21460) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/07 10:22:17 (21460) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/07 10:27:18 (21489) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/07 10:27:18 (21489) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/07 10:27:18 (21489) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/07 10:30:25 (21523) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 10:32:19 (21535) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/07 10:32:19 (21535) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/07 10:32:19 (21535) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/07 10:37:20 (21550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/07 10:37:20 (21550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/07 10:37:20 (21550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/07 10:40:48 (21586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 10:42:21 (21596) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/07 10:42:21 (21596) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/07 10:42:21 (21596) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/07 10:47:22 (21646) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/07 10:47:22 (21646) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/07 10:47:23 (21646) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/07 10:50:02 (21716) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 10:52:23 (21726) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/07 10:52:23 (21726) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/07 10:52:23 (21726) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/07 10:57:24 (21758) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/07 10:57:24 (21758) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/07 10:57:24 (21758) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/07 10:59:25 (21783) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 11:02:25 (21861) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/07 11:02:25 (21861) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/07 11:02:25 (21861) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/07 11:07:26 (21884) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/07 11:07:26 (21884) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/07 11:07:26 (21884) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/07 11:10:23 (21918) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 11:12:27 (21928) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/07 11:12:27 (21928) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/07 11:12:27 (21928) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/07 11:17:28 (21944) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/07 11:17:28 (21944) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/07 11:17:28 (21944) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/07 11:21:00 (22036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 11:22:29 (22059) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/07 11:22:29 (22059) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/07 11:22:29 (22059) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/07 11:27:30 (22085) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/07 11:27:30 (22085) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/07 11:27:30 (22085) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/07 11:31:05 (22128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 11:32:31 (22140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/07 11:32:31 (22140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/07 11:32:31 (22140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/07 11:37:32 (22149) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/07 11:37:32 (22149) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/07 11:37:32 (22149) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/07 11:41:27 (22186) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 11:42:33 (22193) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/07 11:42:33 (22193) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/07 11:42:33 (22193) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/07 11:47:34 (22203) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/07 11:47:34 (22203) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/07 11:47:34 (22203) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/07 11:52:24 (22322) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 11:52:35 (22328) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/07 11:52:35 (22328) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/07 11:52:35 (22328) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/07 11:57:36 (22353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/07 11:57:36 (22353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/07 11:57:36 (22353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/07 12:02:37 (22435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/07 12:02:37 (22435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/07 12:02:37 (22435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/07 12:03:03 (22457) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 12:07:38 (22475) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/07 12:07:38 (22475) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/07 12:07:38 (22475) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/07 12:12:39 (22496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/07 12:12:39 (22496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/07 12:12:39 (22496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/07 12:13:46 (22519) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 12:17:40 (22534) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/07 12:17:40 (22534) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/07 12:17:40 (22534) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/07 12:22:41 (22611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/07 12:22:41 (22611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/07 12:22:41 (22611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/07 12:24:47 (22672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 12:27:43 (22680) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/07 12:27:43 (22680) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/07 12:27:43 (22680) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/07 12:32:43 (22711) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/07 12:32:43 (22711) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/07 12:32:43 (22711) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/07 12:33:51 (22734) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 12:37:44 (22747) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/07 12:37:44 (22747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/07 12:37:44 (22747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/07 12:42:45 (22768) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/07 12:42:45 (22768) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/07 12:42:45 (22768) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/07 12:44:27 (22792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 12:47:46 (22806) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/07 12:47:46 (22806) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/07 12:47:46 (22806) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/07 12:52:47 (22864) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/07 12:52:47 (22864) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/07 12:52:47 (22864) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/07 12:54:11 (22912) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 12:57:48 (22948) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/07 12:57:48 (22948) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/07 12:57:48 (22948) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/07 13:02:49 (23034) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/07 13:02:49 (23034) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/07 13:02:49 (23034) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/07 13:04:44 (23056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 13:07:50 (23066) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/07 13:07:50 (23066) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/07 13:07:50 (23066) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/07 13:12:51 (23089) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/07 13:12:51 (23089) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/07 13:12:51 (23089) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/07 13:15:09 (23112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 13:17:52 (23126) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/07 13:17:52 (23126) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/07 13:17:52 (23126) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/07 13:22:53 (23160) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/07 13:22:53 (23160) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/07 13:22:53 (23160) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/07 13:25:50 (23262) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 13:27:54 (23270) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/07 13:27:54 (23270) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/07 13:27:54 (23270) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/07 13:32:55 (23298) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/07 13:32:55 (23298) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/07 13:32:55 (23298) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/07 13:36:01 (23326) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 13:37:56 (23334) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/07 13:37:56 (23334) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/07 13:37:56 (23334) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/07 13:42:57 (23352) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/07 13:42:57 (23352) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/07 13:42:57 (23352) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/07 13:46:00 (23377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 13:47:58 (23385) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/07 13:47:58 (23385) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/07 13:47:58 (23385) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/07 13:52:59 (23408) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/07 13:52:59 (23408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/07 13:52:59 (23408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/07 13:56:51 (23516) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 13:58:00 (23539) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/07 13:58:00 (23539) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/07 13:58:00 (23539) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/07 14:03:01 (23622) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/07 14:03:01 (23622) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/07 14:03:01 (23622) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/07 14:07:48 (23647) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 14:08:02 (23654) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/07 14:08:02 (23654) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/07 14:08:02 (23654) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/07 14:13:03 (23675) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/07 14:13:04 (23675) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/07 14:13:04 (23675) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/07 14:17:29 (23702) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 14:18:04 (23709) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/07 14:18:04 (23709) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/07 14:18:04 (23709) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/07 14:23:05 (23729) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/07 14:23:05 (23729) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/07 14:23:05 (23729) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/07 14:28:06 (23852) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/07 14:28:06 (23852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/07 14:28:06 (23852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/07 14:28:19 (23856) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 14:33:07 (23884) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/07 14:33:07 (23884) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/07 14:33:07 (23884) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/07 14:38:08 (23890) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/07 14:38:08 (23890) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/07 14:38:08 (23890) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/07 14:39:15 (23919) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 14:43:09 (23940) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/07 14:43:09 (23940) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/07 14:43:09 (23940) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/07 14:48:10 (23948) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/07 14:48:10 (23948) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/07 14:48:10 (23948) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/07 14:50:05 (23979) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 14:53:11 (23998) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/07 14:53:11 (23998) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/07 14:53:11 (23998) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/07 14:58:12 (24084) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/07 14:58:12 (24084) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/07 14:58:12 (24084) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/07 14:59:45 (24129) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 15:03:13 (24213) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/07 15:03:13 (24213) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/07 15:03:13 (24213) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/07 15:08:14 (24246) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/07 15:08:14 (24246) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/07 15:08:14 (24246) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/07 15:10:40 (24279) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 15:13:15 (24291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/07 15:13:15 (24291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/07 15:13:15 (24291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/07 15:18:16 (24306) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/07 15:18:16 (24306) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/07 15:18:16 (24306) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/07 15:19:41 (24328) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 15:23:17 (24351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/07 15:23:17 (24351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/07 15:23:17 (24351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/07 15:28:18 (24423) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/07 15:28:18 (24423) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/07 15:28:18 (24423) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/07 15:29:48 (24468) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 15:33:19 (24526) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/07 15:33:19 (24526) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/07 15:33:19 (24526) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/07 15:38:20 (24539) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/07 15:38:20 (24539) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/07 15:38:20 (24539) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/07 15:39:46 (24568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 15:43:21 (24588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/07 15:43:21 (24588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/07 15:43:21 (24588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/07 15:48:22 (24656) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/07 15:48:22 (24656) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/07 15:48:22 (24656) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/07 15:48:47 (24681) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 15:53:23 (24706) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/07 15:53:23 (24706) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/07 15:53:23 (24706) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/07 15:58:24 (24739) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/07 15:58:24 (24739) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/07 15:58:24 (24739) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/07 15:59:42 (24798) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 16:03:26 (24919) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/07 16:03:26 (24919) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/07 16:03:26 (24919) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/07 16:08:26 (24928) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/07 16:08:26 (24928) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/07 16:08:26 (24928) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/07 16:09:35 (24953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 16:13:27 (24974) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/07 16:13:27 (24974) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/07 16:13:27 (24974) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/07 16:18:28 (24989) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/07 16:18:28 (24989) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/07 16:18:28 (24989) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/07 16:19:44 (25014) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 16:23:29 (25030) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/07 16:23:29 (25030) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/07 16:23:29 (25030) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/07 16:28:30 (25068) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/07 16:28:30 (25068) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/07 16:28:30 (25068) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/07 16:29:29 (25093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 16:33:31 (25189) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/07 16:33:31 (25189) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/07 16:33:31 (25189) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/07 16:38:32 (25197) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/07 16:38:32 (25197) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/07 16:38:32 (25197) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/07 16:39:47 (25222) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 16:43:33 (25240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/07 16:43:33 (25240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/07 16:43:33 (25240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/07 16:48:34 (25274) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/07 16:48:34 (25274) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/07 16:48:34 (25274) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/07 16:48:52 (25277) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 16:53:35 (25299) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/07 16:53:35 (25299) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/07 16:53:35 (25299) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/07 16:58:08 (25355) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 16:58:36 (25361) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/07 16:58:36 (25361) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/07 16:58:36 (25361) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/07 17:03:37 (25498) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/07 17:03:37 (25498) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/07 17:03:37 (25498) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/07 17:08:38 (25526) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/07 17:08:38 (25526) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/07 17:08:38 (25526) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/07 17:08:57 (25547) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 17:13:39 (25567) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/07 17:13:39 (25567) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/07 17:13:39 (25567) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/07 17:18:30 (25605) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 17:18:40 (25611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/07 17:18:40 (25611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/07 17:18:40 (25611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/07 17:23:41 (25623) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/07 17:23:41 (25623) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/07 17:23:41 (25623) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/07 17:28:42 (25664) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/07 17:28:42 (25664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/07 17:28:42 (25664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/07 17:29:30 (25689) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 17:33:43 (25759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/07 17:33:43 (25759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/07 17:33:43 (25759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/07 17:38:44 (25813) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/07 17:38:44 (25813) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/07 17:38:44 (25813) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/07 17:38:45 (25814) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 17:43:45 (25835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/07 17:43:45 (25835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/07 17:43:45 (25835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/07 17:48:46 (25865) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/07 17:48:46 (25865) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/07 17:48:46 (25865) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/07 17:49:02 (25869) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 17:53:47 (25889) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/07 17:53:47 (25889) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/07 17:53:47 (25889) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/07 17:58:48 (25939) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/07 17:58:48 (25939) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/07 17:58:48 (25939) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/07 17:59:01 (25940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 18:03:49 (26064) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/07 18:03:49 (26064) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/07 18:03:49 (26064) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/07 18:08:50 (26114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/07 18:08:50 (26114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/07 18:08:50 (26114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/07 18:09:46 (26142) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 18:13:51 (26158) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/07 18:13:51 (26158) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/07 18:13:51 (26158) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/07 18:18:52 (26175) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/07 18:18:52 (26175) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/07 18:18:52 (26175) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/07 18:20:00 (26199) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 18:23:53 (26216) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/07 18:23:53 (26216) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/07 18:23:53 (26216) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/07 18:28:54 (26253) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/07 18:28:54 (26253) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/07 18:28:54 (26253) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/07 18:30:04 (26286) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 18:33:55 (26302) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/07 18:33:55 (26302) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/07 18:33:55 (26302) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/07 18:38:56 (26384) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/07 18:38:56 (26384) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/07 18:38:56 (26384) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/07 18:39:45 (26409) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 18:43:57 (26428) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/07 18:43:57 (26428) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/07 18:43:57 (26428) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/07 18:48:58 (26441) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/07 18:48:58 (26441) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/07 18:48:58 (26441) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/07 18:50:12 (26471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 18:53:59 (26484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/07 18:53:59 (26484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/07 18:53:59 (26484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/07 18:59:00 (26521) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/07 18:59:00 (26521) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/07 18:59:00 (26521) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/07 18:59:35 (26543) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 19:04:01 (26625) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/07 19:04:01 (26625) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/07 19:04:01 (26625) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/07 19:09:02 (26713) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/07 19:09:02 (26713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/07 19:09:02 (26713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/07 19:09:46 (26735) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 19:14:03 (26752) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/07 19:14:03 (26752) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/07 19:14:03 (26752) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/07 19:19:04 (26772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/07 19:19:04 (26772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/07 19:19:04 (26772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/07 19:20:44 (26802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 19:24:05 (26812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/07 19:24:05 (26812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/07 19:24:05 (26812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/07 19:29:06 (26845) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/07 19:29:06 (26845) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/07 19:29:06 (26845) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/07 19:31:01 (26881) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 19:34:07 (26891) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/07 19:34:07 (26891) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/07 19:34:07 (26891) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/07 19:39:08 (26964) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/07 19:39:08 (26964) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/07 19:39:08 (26964) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/07 19:41:03 (27009) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 19:44:09 (27022) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/07 19:44:09 (27022) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/07 19:44:09 (27022) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/07 19:49:10 (27039) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/07 19:49:10 (27039) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/07 19:49:10 (27039) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/07 19:51:09 (27069) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 19:54:12 (27082) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/07 19:54:12 (27082) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/07 19:54:12 (27082) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/07 19:59:12 (27112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/07 19:59:12 (27112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/07 19:59:12 (27112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/07 20:01:37 (27210) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 20:04:13 (27219) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/07 20:04:13 (27219) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/07 20:04:13 (27219) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/07 20:09:14 (27275) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/07 20:09:14 (27275) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/07 20:09:14 (27275) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/07 20:11:19 (27339) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 20:14:15 (27350) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/07 20:14:15 (27350) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/07 20:14:15 (27350) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/07 20:19:16 (27371) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/07 20:19:16 (27371) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/07 20:19:16 (27371) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/07 20:21:07 (27401) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 20:24:17 (27414) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/07 20:24:17 (27414) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/07 20:24:17 (27414) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/07 20:29:18 (27446) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/07 20:29:18 (27446) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/07 20:29:18 (27446) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/07 20:31:47 (27480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 20:34:19 (27492) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/07 20:34:19 (27492) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/07 20:34:19 (27492) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/07 20:39:20 (27522) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/07 20:39:20 (27522) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/07 20:39:20 (27522) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/07 20:41:17 (27593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 20:44:21 (27625) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/07 20:44:21 (27625) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/07 20:44:21 (27625) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/07 20:49:22 (27638) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/07 20:49:22 (27638) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/07 20:49:22 (27638) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/07 20:50:40 (27666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 20:54:23 (27683) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/07 20:54:23 (27683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/07 20:54:23 (27683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/07 20:59:24 (27715) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/07 20:59:24 (27715) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/07 20:59:24 (27715) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/07 21:00:46 (27785) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 21:04:25 (27819) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/07 21:04:25 (27819) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/07 21:04:25 (27819) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/07 21:09:26 (27837) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/07 21:09:26 (27837) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/07 21:09:26 (27837) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/07 21:10:30 (27877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 21:14:27 (27954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/07 21:14:27 (27954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/07 21:14:27 (27954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/07 21:19:28 (27993) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/07 21:19:28 (27993) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/07 21:19:28 (27993) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/07 21:19:33 (27994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 21:24:29 (28023) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/07 21:24:29 (28023) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/07 21:24:29 (28023) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/07 21:29:00 (28078) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 21:29:30 (28085) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/07 21:29:30 (28085) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/07 21:29:30 (28085) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/07 21:34:31 (28098) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/07 21:34:31 (28098) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/07 21:34:31 (28098) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/07 21:38:22 (28135) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 21:39:32 (28142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/07 21:39:32 (28142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/07 21:39:32 (28142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/07 21:44:33 (28232) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/07 21:44:33 (28232) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/07 21:44:33 (28232) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/07 21:48:42 (28266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 21:49:34 (28273) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/07 21:49:34 (28273) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/07 21:49:34 (28273) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/07 21:54:36 (28290) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/07 21:54:36 (28290) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/07 21:54:36 (28290) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/07 21:59:05 (28341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 21:59:36 (28348) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/07 21:59:36 (28348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/07 21:59:36 (28348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/07 22:04:37 (28422) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/07 22:04:37 (28422) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/07 22:04:37 (28422) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/07 22:08:45 (28454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 22:09:38 (28466) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/07 22:09:38 (28466) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/07 22:09:38 (28466) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/07 22:14:39 (28534) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/07 22:14:39 (28534) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/07 22:14:39 (28534) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/07 22:19:06 (28594) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 22:19:40 (28603) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/07 22:19:40 (28603) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/07 22:19:40 (28603) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/07 22:24:41 (28615) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/07 22:24:41 (28615) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/07 22:24:41 (28615) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/07 22:29:42 (28671) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/07 22:29:42 (28671) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/07 22:29:42 (28671) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/07 22:29:46 (28672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 22:34:43 (28690) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/07 22:34:43 (28690) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/07 22:34:43 (28690) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/07 22:39:44 (28706) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/07 22:39:44 (28706) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/07 22:39:44 (28706) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/07 22:40:26 (28736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 22:44:45 (28786) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/07 22:44:45 (28786) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/07 22:44:45 (28786) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/07 22:49:46 (28840) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/07 22:49:46 (28840) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/07 22:49:46 (28840) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/07 22:51:15 (28866) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 22:54:47 (28881) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/07 22:54:47 (28881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/07 22:54:47 (28881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/07 22:59:48 (28918) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/07 22:59:48 (28918) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/07 22:59:48 (28918) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/07 23:01:30 (29009) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 23:04:49 (29018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/07 23:04:49 (29018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/07 23:04:49 (29018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/07 23:09:50 (29054) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/07 23:09:50 (29054) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/07 23:09:50 (29054) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/07 23:11:26 (29089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 23:14:51 (29105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/07 23:14:51 (29105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/07 23:14:51 (29105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/07 23:19:52 (29196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/07 23:19:52 (29196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/07 23:19:52 (29196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/07 23:21:00 (29226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 23:24:53 (29242) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/07 23:24:53 (29242) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/07 23:24:53 (29242) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/07 23:29:54 (29274) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/07 23:29:54 (29274) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/07 23:29:54 (29274) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/07 23:31:41 (29328) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 23:34:55 (29337) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/07 23:34:55 (29337) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/07 23:34:55 (29337) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/07 23:39:56 (29353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/07 23:39:56 (29353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/07 23:39:56 (29353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/07 23:41:48 (29383) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 23:44:57 (29396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/07 23:44:57 (29396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/07 23:44:57 (29396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/07 23:49:59 (29544) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/07 23:49:59 (29544) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/07 23:49:59 (29544) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/07 23:52:30 (29578) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/07 23:55:00 (29596) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/07 23:55:00 (29596) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/07 23:55:00 (29596) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/08 00:00:01 (29626) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/08 00:00:01 (29626) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/08 00:00:01 (29626) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/08 00:02:19 (29728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 00:05:02 (29737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/08 00:05:02 (29737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/08 00:05:02 (29737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/08 00:10:03 (29754) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/08 00:10:03 (29754) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/08 00:10:03 (29754) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/08 00:12:15 (29782) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 00:15:04 (29795) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/08 00:15:04 (29795) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/08 00:15:04 (29795) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/08 00:20:05 (29874) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/08 00:20:05 (29874) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/08 00:20:05 (29874) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/08 00:22:23 (29925) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 00:25:06 (29937) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/08 00:25:06 (29937) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/08 00:25:06 (29937) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/08 00:30:07 (29973) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/08 00:30:07 (29973) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/08 00:30:07 (29973) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/08 00:32:57 (29999) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 00:35:08 (30007) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/08 00:35:08 (30007) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/08 00:35:08 (30007) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/08 00:40:09 (30027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/08 00:40:09 (30027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/08 00:40:09 (30027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/08 00:43:17 (30053) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 00:45:10 (30068) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/08 00:45:10 (30068) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/08 00:45:10 (30068) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/08 00:50:11 (30140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/08 00:50:11 (30140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/08 00:50:11 (30140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/08 00:53:47 (30191) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 00:55:12 (30201) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/08 00:55:12 (30201) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/08 00:55:12 (30201) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/08 01:00:13 (30279) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/08 01:00:13 (30279) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/08 01:00:13 (30279) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/08 01:03:56 (30330) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 01:05:24 (30401) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/08 01:05:24 (30401) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/08 01:05:24 (30401) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/08 01:06:20 (30483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 01:10:25 (30519) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/08 01:10:25 (30519) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/08 01:10:25 (30519) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/08 01:15:27 (30528) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/08 01:15:27 (30528) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/08 01:15:27 (30528) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/08 01:16:22 (30549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 01:20:27 (30609) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/08 01:20:27 (30609) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/08 01:20:27 (30609) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/08 01:25:28 (30655) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/08 01:25:28 (30655) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/08 01:25:28 (30655) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/08 01:26:50 (30683) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 01:30:29 (30720) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/08 01:30:29 (30720) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/08 01:30:29 (30720) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/08 01:35:30 (30732) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/08 01:35:30 (30732) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/08 01:35:30 (30732) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/08 01:35:52 (30753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 01:40:31 (30785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/08 01:40:31 (30785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/08 01:40:31 (30785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/08 01:45:32 (30794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/08 01:45:32 (30794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/08 01:45:32 (30794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/08 01:46:02 (30818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 01:50:33 (30839) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/08 01:50:33 (30839) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/08 01:50:33 (30839) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/08 01:55:34 (30925) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/08 01:55:34 (30925) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/08 01:55:34 (30925) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/08 01:56:49 (30947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 02:00:35 (31035) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/08 02:00:35 (31035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/08 02:00:35 (31035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/08 02:05:36 (31077) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/08 02:05:36 (31077) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/08 02:05:36 (31077) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/08 02:07:37 (31105) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 02:10:37 (31121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/08 02:10:37 (31121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/08 02:10:37 (31121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/08 02:15:38 (31138) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/08 02:15:38 (31138) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/08 02:15:38 (31138) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/08 02:18:00 (31166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 02:20:39 (31179) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/08 02:20:39 (31179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/08 02:20:39 (31179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/08 02:25:40 (31265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/08 02:25:40 (31265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/08 02:25:40 (31265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/08 02:28:47 (31316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 02:30:41 (31390) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/08 02:30:41 (31390) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/08 02:30:41 (31390) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/08 02:35:42 (31408) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/08 02:35:42 (31408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/08 02:35:42 (31408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/08 02:38:45 (31437) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 02:40:43 (31450) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/08 02:40:43 (31450) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/08 02:40:43 (31450) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/08 02:45:44 (31461) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/08 02:45:44 (31461) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/08 02:45:44 (31461) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/08 02:49:28 (31490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 02:50:45 (31502) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/08 02:50:45 (31502) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/08 02:50:45 (31502) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/08 02:55:46 (31570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/08 02:55:46 (31570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/08 02:55:46 (31570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/08 03:00:20 (31687) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 03:00:47 (31694) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/08 03:00:47 (31694) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/08 03:00:47 (31694) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/08 03:05:48 (31735) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/08 03:05:48 (31735) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/08 03:05:48 (31735) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/08 03:10:49 (31759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/08 03:10:49 (31759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/08 03:10:49 (31759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/08 03:11:12 (31780) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 03:15:50 (31798) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/08 03:15:51 (31798) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/08 03:15:51 (31798) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/08 03:20:52 (31817) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/08 03:20:52 (31817) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/08 03:20:52 (31817) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/08 03:21:40 (31839) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 03:25:53 (31908) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/08 03:25:53 (31908) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/08 03:25:53 (31908) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/08 03:30:54 (31961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/08 03:30:54 (31961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/08 03:30:54 (31961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/08 03:32:12 (31990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 03:35:55 (32006) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/08 03:35:55 (32006) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/08 03:35:55 (32006) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/08 03:40:56 (32021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/08 03:40:56 (32021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/08 03:40:56 (32021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/08 03:41:25 (32043) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 03:45:57 (32061) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/08 03:45:57 (32061) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/08 03:45:57 (32061) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/08 03:50:58 (32089) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/08 03:50:58 (32089) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/08 03:50:58 (32089) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/08 03:52:15 (32113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 03:55:59 (32192) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/08 03:55:59 (32192) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/08 03:55:59 (32192) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/08 04:01:00 (32320) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/08 04:01:00 (32320) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/08 04:01:00 (32320) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/08 04:01:43 (32365) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 04:06:01 (32384) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/08 04:06:01 (32384) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/08 04:06:01 (32384) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/08 04:11:02 (32431) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/08 04:11:02 (32431) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/08 04:11:02 (32431) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/08 04:11:43 (32453) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 04:16:03 (32476) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/08 04:16:03 (32476) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/08 04:16:03 (32476) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/08 04:21:04 (32495) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/08 04:21:04 (32495) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/08 04:21:04 (32495) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/08 04:22:20 (32517) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 04:26:05 (32533) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/08 04:26:05 (32533) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/08 04:26:05 (32533) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/08 04:31:06 (434) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/08 04:31:06 (434) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/08 04:31:06 (434) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/08 04:32:54 (462) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 04:36:07 (479) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/08 04:36:07 (479) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/08 04:36:07 (479) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/08 04:41:08 (493) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/08 04:41:08 (493) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/08 04:41:08 (493) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/08 04:42:26 (518) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 04:46:09 (534) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/08 04:46:09 (534) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/08 04:46:09 (534) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/08 04:51:10 (547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/08 04:51:10 (547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/08 04:51:10 (547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/08 04:53:10 (572) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 04:56:11 (583) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/08 04:56:11 (583) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/08 04:56:11 (583) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/08 05:01:12 (755) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/08 05:01:12 (755) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/08 05:01:12 (755) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/08 05:02:41 (785) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 05:06:14 (801) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/08 05:06:14 (801) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/08 05:06:14 (801) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/08 05:11:14 (818) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/08 05:11:14 (818) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/08 05:11:14 (818) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/08 05:12:33 (840) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 05:16:15 (865) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/08 05:16:15 (865) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/08 05:16:15 (865) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/08 05:21:16 (885) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/08 05:21:16 (885) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/08 05:21:16 (885) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/08 05:22:26 (907) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 05:26:17 (919) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/08 05:26:17 (919) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/08 05:26:17 (919) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/08 05:31:18 (1013) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/08 05:31:18 (1013) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/08 05:31:18 (1013) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/08 05:32:44 (1063) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 05:36:19 (1075) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/08 05:36:19 (1075) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/08 05:36:19 (1075) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/08 05:41:20 (1094) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/08 05:41:20 (1094) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/08 05:41:20 (1094) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/08 05:41:47 (1118) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 05:46:21 (1136) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/08 05:46:21 (1136) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/08 05:46:21 (1136) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/08 05:51:14 (1180) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 05:51:22 (1186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/08 05:51:22 (1186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/08 05:51:22 (1186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/08 05:56:23 (1195) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/08 05:56:23 (1195) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/08 05:56:23 (1195) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/08 06:01:24 (1366) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/08 06:01:24 (1366) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/08 06:01:24 (1366) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/08 06:01:38 (1384) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 06:06:25 (1423) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/08 06:06:25 (1423) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/08 06:06:25 (1423) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/08 06:11:26 (1472) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/08 06:11:26 (1472) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/08 06:11:26 (1472) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/08 06:11:36 (1473) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 06:16:27 (1495) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/08 06:16:27 (1495) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/08 06:16:27 (1495) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/08 06:20:44 (1543) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 06:21:28 (1549) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/08 06:21:28 (1549) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/08 06:21:28 (1549) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/08 06:26:29 (1558) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/08 06:26:29 (1558) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/08 06:26:29 (1558) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/08 06:29:46 (1600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 06:31:30 (1643) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/08 06:31:30 (1643) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/08 06:31:30 (1643) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/08 06:36:31 (1721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/08 06:36:31 (1721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/08 06:36:31 (1721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/08 06:38:51 (1751) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 06:41:32 (1767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/08 06:41:32 (1767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/08 06:41:32 (1767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/08 06:46:33 (1780) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/08 06:46:33 (1780) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/08 06:46:33 (1780) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/08 06:48:22 (1806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 06:51:34 (1822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/08 06:51:34 (1822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/08 06:51:34 (1822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/08 06:56:36 (1841) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/08 06:56:36 (1841) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/08 06:56:36 (1841) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/08 06:57:41 (1865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 07:01:37 (1981) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/08 07:01:37 (1981) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/08 07:01:37 (1981) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/08 07:06:38 (2076) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/08 07:06:38 (2076) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/08 07:06:38 (2076) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/08 07:07:57 (2100) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 07:11:39 (2158) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/08 07:11:39 (2158) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/08 07:11:39 (2158) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/08 07:16:40 (2178) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/08 07:16:40 (2178) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/08 07:16:40 (2178) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/08 07:18:15 (2201) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 07:21:41 (2220) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/08 07:21:41 (2220) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/08 07:21:41 (2220) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/08 07:26:42 (2236) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/08 07:26:42 (2236) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/08 07:26:42 (2236) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/08 07:28:59 (2269) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 07:31:43 (2307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/08 07:31:43 (2307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/08 07:31:43 (2307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/08 07:36:44 (2403) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/08 07:36:44 (2403) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/08 07:36:44 (2403) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/08 07:38:19 (2446) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 07:41:45 (2468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/08 07:41:45 (2468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/08 07:41:45 (2468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/08 07:46:46 (2480) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/08 07:46:46 (2480) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/08 07:46:46 (2480) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/08 07:47:25 (2503) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 07:51:47 (2581) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/08 07:51:47 (2581) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/08 07:51:47 (2581) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/08 07:56:48 (2590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/08 07:56:48 (2590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/08 07:56:48 (2590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/08 07:57:10 (2611) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 08:01:49 (2715) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/08 08:01:49 (2715) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/08 08:01:49 (2715) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/08 08:06:26 (2805) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 08:06:50 (2812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/08 08:06:50 (2812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/08 08:06:50 (2812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/08 08:11:51 (2851) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/08 08:11:51 (2851) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/08 08:11:51 (2851) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/08 08:15:46 (2882) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 08:16:52 (2893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/08 08:16:52 (2893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/08 08:16:52 (2893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/08 08:21:53 (2911) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/08 08:21:53 (2911) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/08 08:21:53 (2911) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/08 08:25:20 (2937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 08:26:54 (2945) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/08 08:26:54 (2945) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/08 08:26:54 (2945) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/08 08:31:55 (2983) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/08 08:31:55 (2983) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/08 08:31:55 (2983) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/08 08:34:46 (3010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 08:36:56 (3060) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/08 08:36:56 (3060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/08 08:36:56 (3060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/08 08:41:57 (3116) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/08 08:41:57 (3116) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/08 08:41:57 (3116) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/08 08:43:57 (3143) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 08:46:59 (3155) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/08 08:46:59 (3155) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/08 08:46:59 (3155) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/08 08:52:00 (3170) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/08 08:52:00 (3170) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/08 08:52:00 (3170) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/08 08:54:40 (3196) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 08:57:01 (3210) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/08 08:57:01 (3210) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/08 08:57:01 (3210) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/08 09:02:02 (3309) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/08 09:02:02 (3309) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/08 09:02:02 (3309) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/08 09:05:04 (3341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 09:07:03 (3352) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/08 09:07:03 (3352) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/08 09:07:03 (3352) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/08 09:12:04 (3442) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/08 09:12:04 (3442) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/08 09:12:04 (3442) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/08 09:14:21 (3471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 09:17:05 (3489) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/08 09:17:05 (3489) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/08 09:17:05 (3489) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/08 09:22:06 (3503) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/08 09:22:06 (3503) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/08 09:22:06 (3503) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/08 09:23:28 (3531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 09:27:07 (3549) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/08 09:27:07 (3549) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/08 09:27:07 (3549) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/08 09:32:08 (3584) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/08 09:32:08 (3584) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/08 09:32:08 (3584) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/08 09:32:48 (3607) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 09:37:09 (3624) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/08 09:37:09 (3624) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/08 09:37:09 (3624) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/08 09:42:10 (3712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/08 09:42:10 (3712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/08 09:42:10 (3712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/08 09:43:23 (3737) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 09:47:11 (3756) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/08 09:47:11 (3756) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/08 09:47:11 (3756) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/08 09:52:12 (3770) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/08 09:52:12 (3770) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/08 09:52:12 (3770) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/08 09:53:56 (3796) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 09:57:13 (3813) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/08 09:57:13 (3813) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/08 09:57:13 (3813) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/08 10:02:14 (3909) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/08 10:02:14 (3909) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/08 10:02:14 (3909) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/08 10:03:42 (3940) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 10:07:15 (3953) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/08 10:07:15 (3953) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/08 10:07:15 (3953) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/08 10:12:16 (4024) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/08 10:12:16 (4024) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/08 10:12:16 (4024) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/08 10:12:44 (4066) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 10:17:17 (4093) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/08 10:17:17 (4093) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/08 10:17:17 (4093) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/08 10:22:02 (4123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 10:22:18 (4129) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/08 10:22:18 (4129) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/08 10:22:18 (4129) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/08 10:27:19 (4144) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/08 10:27:19 (4144) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/08 10:27:19 (4144) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/08 10:31:57 (4202) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 10:32:20 (4211) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/08 10:32:20 (4211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/08 10:32:20 (4211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/08 10:37:21 (4219) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/08 10:37:21 (4219) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/08 10:37:21 (4219) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/08 10:42:23 (4293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/08 10:42:23 (4293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/08 10:42:23 (4293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/08 10:42:49 (4314) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 10:47:24 (4352) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/08 10:47:24 (4352) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/08 10:47:24 (4352) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/08 10:52:25 (4373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/08 10:52:25 (4373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/08 10:52:25 (4373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/08 10:53:27 (4395) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 10:57:26 (4409) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/08 10:57:26 (4409) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/08 10:57:26 (4409) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/08 11:02:27 (4510) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/08 11:02:27 (4510) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/08 11:02:27 (4510) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/08 11:04:09 (4537) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 11:07:28 (4550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/08 11:07:28 (4550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/08 11:07:28 (4550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/08 11:12:29 (4603) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/08 11:12:29 (4603) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/08 11:12:29 (4603) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/08 11:14:01 (4644) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 11:17:30 (4684) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/08 11:17:30 (4684) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/08 11:17:30 (4684) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/08 11:22:31 (4703) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/08 11:22:31 (4703) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/08 11:22:31 (4703) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/08 11:24:34 (4732) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 11:27:32 (4744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/08 11:27:32 (4744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/08 11:27:32 (4744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/08 11:32:33 (4784) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/08 11:32:33 (4784) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/08 11:32:33 (4784) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/08 11:35:04 (4808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 11:37:34 (4819) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/08 11:37:34 (4819) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/08 11:37:34 (4819) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/08 11:42:35 (4838) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/08 11:42:35 (4838) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/08 11:42:35 (4838) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/08 11:45:02 (4915) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 11:47:36 (4951) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/08 11:47:36 (4951) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/08 11:47:36 (4951) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/08 11:52:37 (4970) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/08 11:52:37 (4970) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/08 11:52:37 (4970) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/08 11:54:25 (4997) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 11:57:38 (5010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/08 11:57:38 (5010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/08 11:57:38 (5010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/08 12:02:39 (5112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/08 12:02:39 (5112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/08 12:02:39 (5112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/08 12:03:38 (5134) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 12:07:40 (5148) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/08 12:07:40 (5148) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/08 12:07:40 (5148) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/08 12:12:41 (5164) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/08 12:12:41 (5164) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/08 12:12:41 (5164) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/08 12:14:13 (5190) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 12:17:42 (5280) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/08 12:17:42 (5280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/08 12:17:42 (5280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/08 12:22:43 (5301) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/08 12:22:43 (5301) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/08 12:22:43 (5301) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/08 12:25:01 (5329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 12:27:44 (5339) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/08 12:27:44 (5339) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/08 12:27:44 (5339) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/08 12:32:45 (5382) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/08 12:32:45 (5382) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/08 12:32:45 (5382) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/08 12:34:52 (5405) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 12:37:46 (5417) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/08 12:37:46 (5417) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/08 12:37:46 (5417) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/08 12:42:48 (5434) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/08 12:42:48 (5434) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/08 12:42:48 (5434) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/08 12:44:41 (5460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 12:47:48 (5524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/08 12:47:48 (5524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/08 12:47:48 (5524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/08 12:52:49 (5566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/08 12:52:49 (5566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/08 12:52:49 (5566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/08 12:55:32 (5598) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 12:57:50 (5611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/08 12:57:50 (5611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/08 12:57:50 (5611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/08 13:02:51 (5712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/08 13:02:51 (5712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/08 13:02:51 (5712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/08 13:05:16 (5739) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 13:07:52 (5747) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/08 13:07:52 (5747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/08 13:07:52 (5747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/08 13:12:53 (5764) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/08 13:12:53 (5764) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/08 13:12:53 (5764) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/08 13:16:04 (5794) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 13:17:54 (5843) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/08 13:17:54 (5843) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/08 13:17:54 (5843) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/08 13:22:55 (5900) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/08 13:22:55 (5900) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/08 13:22:55 (5900) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/08 13:26:23 (5932) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 13:27:56 (5943) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/08 13:27:56 (5943) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/08 13:27:56 (5943) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/08 13:32:57 (5982) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/08 13:32:57 (5982) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/08 13:32:57 (5982) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/08 13:37:18 (6011) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 13:37:58 (6017) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/08 13:37:58 (6017) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/08 13:37:58 (6017) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/08 13:42:59 (6034) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/08 13:42:59 (6034) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/08 13:42:59 (6034) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/08 13:46:22 (6061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 13:48:00 (6088) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/08 13:48:00 (6088) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/08 13:48:00 (6088) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/08 13:53:01 (6164) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/08 13:53:01 (6164) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/08 13:53:01 (6164) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/08 13:57:09 (6197) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 13:58:02 (6203) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/08 13:58:02 (6203) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/08 13:58:02 (6203) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/08 14:03:03 (6307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/08 14:03:03 (6307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/08 14:03:03 (6307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/08 14:07:10 (6386) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 14:08:04 (6392) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/08 14:08:04 (6392) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/08 14:08:04 (6392) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/08 14:13:05 (6408) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/08 14:13:05 (6408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/08 14:13:05 (6408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/08 14:17:09 (6437) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 14:18:06 (6447) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/08 14:18:06 (6447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/08 14:18:06 (6447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/08 14:23:07 (6606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/08 14:23:07 (6606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/08 14:23:07 (6606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/08 14:26:11 (6636) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 14:28:08 (6647) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/08 14:28:08 (6647) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/08 14:28:08 (6647) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/08 14:33:09 (6685) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/08 14:33:09 (6685) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/08 14:33:09 (6685) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/08 14:35:33 (6712) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 14:38:10 (6747) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/08 14:38:10 (6747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/08 14:38:10 (6747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/08 14:43:12 (6779) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/08 14:43:12 (6779) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/08 14:43:12 (6779) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/08 14:44:49 (6803) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 14:48:12 (6816) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/08 14:48:12 (6816) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/08 14:48:12 (6816) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/08 14:53:13 (6917) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/08 14:53:13 (6917) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/08 14:53:13 (6917) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/08 14:55:13 (6943) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 14:58:14 (6959) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/08 14:58:14 (6959) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/08 14:58:14 (6959) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/08 15:03:15 (7055) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/08 15:03:15 (7055) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/08 15:03:15 (7055) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/08 15:05:26 (7081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 15:08:16 (7093) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/08 15:08:16 (7093) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/08 15:08:16 (7093) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/08 15:13:17 (7130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/08 15:13:17 (7130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/08 15:13:17 (7130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/08 15:15:00 (7155) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 15:18:18 (7170) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/08 15:18:18 (7170) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/08 15:18:18 (7170) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/08 15:23:19 (7254) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/08 15:23:19 (7254) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/08 15:23:19 (7254) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/08 15:25:25 (7299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 15:28:20 (7315) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/08 15:28:20 (7315) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/08 15:28:20 (7315) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/08 15:33:21 (7351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/08 15:33:21 (7351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/08 15:33:21 (7351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/08 15:34:41 (7396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 15:38:22 (7410) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/08 15:38:22 (7410) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/08 15:38:22 (7410) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/08 15:43:23 (7426) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/08 15:43:23 (7426) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/08 15:43:23 (7426) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/08 15:45:32 (7449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 15:48:24 (7461) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/08 15:48:24 (7461) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/08 15:48:24 (7461) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/08 15:53:25 (7577) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/08 15:53:25 (7577) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/08 15:53:25 (7577) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/08 15:54:40 (7620) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 15:58:26 (7660) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/08 15:58:26 (7660) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/08 15:58:26 (7660) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/08 16:03:27 (7752) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/08 16:03:27 (7752) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/08 16:03:27 (7752) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/08 16:04:19 (7776) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 16:08:28 (7792) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/08 16:08:28 (7792) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/08 16:08:28 (7792) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/08 16:13:29 (7804) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/08 16:13:29 (7804) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/08 16:13:29 (7804) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/08 16:14:34 (7826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 16:18:30 (7844) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/08 16:18:30 (7844) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/08 16:18:30 (7844) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/08 16:23:31 (7870) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/08 16:23:31 (7870) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/08 16:23:31 (7870) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/08 16:24:20 (7927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 16:28:32 (7986) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/08 16:28:32 (7986) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/08 16:28:33 (7986) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/08 16:33:34 (8019) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/08 16:33:34 (8019) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/08 16:33:34 (8019) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/08 16:34:06 (8044) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 16:38:34 (8059) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/08 16:38:34 (8059) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/08 16:38:34 (8059) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/08 16:43:35 (8094) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/08 16:43:35 (8094) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/08 16:43:35 (8094) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/08 16:43:43 (8095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 16:48:36 (8112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/08 16:48:36 (8112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/08 16:48:36 (8112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/08 16:53:37 (8134) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/08 16:53:37 (8134) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/08 16:53:37 (8134) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/08 16:54:07 (8161) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 16:58:38 (8249) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/08 16:58:38 (8249) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/08 16:58:38 (8249) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/08 17:03:39 (8344) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/08 17:03:39 (8344) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/08 17:03:39 (8344) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/08 17:04:43 (8373) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 17:08:40 (8386) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/08 17:08:40 (8386) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/08 17:08:40 (8386) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/08 17:13:41 (8396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/08 17:13:41 (8396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/08 17:13:41 (8396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/08 17:15:01 (8424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 17:18:42 (8445) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/08 17:18:42 (8445) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/08 17:18:42 (8445) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/08 17:23:43 (8458) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/08 17:23:43 (8458) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/08 17:23:43 (8458) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/08 17:24:09 (8482) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 17:28:44 (8561) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/08 17:28:44 (8561) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/08 17:28:44 (8561) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/08 17:33:45 (8614) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/08 17:33:45 (8614) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/08 17:33:45 (8614) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/08 17:35:09 (8642) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 17:38:46 (8655) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/08 17:38:46 (8655) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/08 17:38:46 (8655) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/08 17:43:47 (8668) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/08 17:43:47 (8668) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/08 17:43:47 (8668) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/08 17:45:46 (8696) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 17:48:48 (8707) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/08 17:48:48 (8707) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/08 17:48:48 (8707) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/08 17:53:49 (8723) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/08 17:53:49 (8723) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/08 17:53:49 (8723) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/08 17:56:40 (8755) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 17:58:50 (8819) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/08 17:58:50 (8819) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/08 17:58:50 (8819) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/08 18:03:51 (8927) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/08 18:03:51 (8927) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/08 18:03:51 (8927) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/08 18:06:16 (8965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:08:52 (8978) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/08 18:08:52 (8978) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/08 18:08:52 (8978) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/08 18:13:53 (8988) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/08 18:13:53 (8988) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/08 18:13:53 (8988) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/08 18:15:51 (9018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:18:54 (9035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:18:55 (9035) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 18:18:55 (9035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 18:18:55 (9035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 18:23:55 (9053) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/08 18:23:55 (9053) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/08 18:23:55 (9053) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/08 18:26:23 (9079) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:28:56 (9132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:28:57 (9132) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 18:28:57 (9132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 18:28:57 (9132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 18:33:58 (9197) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/08 18:33:58 (9197) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/08 18:33:58 (9197) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/08 18:36:21 (9236) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:38:58 (9249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:38:58 (9249) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 18:38:58 (9249) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 18:38:58 (9249) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 18:43:59 (9261) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/08 18:43:59 (9261) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/08 18:43:59 (9261) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/08 18:46:01 (9286) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:49:00 (9300) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/08 18:49:00 (9300) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/08 18:49:00 (9300) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/08 18:54:01 (9322) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/08 18:54:01 (9322) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/08 18:54:01 (9322) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/08 18:55:41 (9348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 18:59:02 (9367) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/08 18:59:02 (9367) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/08 18:59:02 (9367) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/08 19:04:03 (9523) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/08 19:04:03 (9523) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/08 19:04:03 (9523) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/08 19:05:44 (9558) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:09:04 (9573) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:09:04 (9573) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 19:09:04 (9573) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 19:09:04 (9573) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 19:14:05 (9589) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/08 19:14:05 (9589) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/08 19:14:05 (9589) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/08 19:15:14 (9611) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:19:06 (9634) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:19:06 (9634) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 19:19:06 (9634) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 19:19:06 (9634) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 19:24:07 (9657) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/08 19:24:07 (9657) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/08 19:24:07 (9657) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/08 19:24:30 (9679) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:29:08 (9697) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:29:08 (9697) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 19:29:08 (9697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 19:29:08 (9697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 19:33:45 (9823) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:34:09 (9829) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/08 19:34:09 (9829) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/08 19:34:09 (9829) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/08 19:39:10 (9852) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:39:10 (9852) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 19:39:10 (9852) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 19:39:10 (9852) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 19:43:36 (9887) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:44:11 (9893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/08 19:44:11 (9893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/08 19:44:11 (9893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/08 19:49:12 (9910) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/08 19:49:12 (9910) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/08 19:49:12 (9910) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/08 19:52:56 (9941) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 19:54:13 (9952) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/08 19:54:13 (9952) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/08 19:54:13 (9952) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/08 19:59:14 (9968) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/08 19:59:14 (9968) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/08 19:59:14 (9968) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/08 20:02:13 (10076) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 20:04:15 (10135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/08 20:04:15 (10135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/08 20:04:15 (10135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/08 20:09:16 (10173) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/08 20:09:16 (10173) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/08 20:09:16 (10173) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/08 20:12:58 (10205) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 20:14:17 (10212) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/08 20:14:17 (10212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/08 20:14:17 (10212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/08 20:19:19 (10230) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/08 20:19:19 (10230) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/08 20:19:19 (10230) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/08 20:23:17 (10264) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 20:24:19 (10273) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/08 20:24:19 (10273) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/08 20:24:19 (10273) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/08 20:29:20 (10290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 20:29:20 (10290) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 20:29:20 (10290) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 20:29:20 (10290) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 20:32:48 (10327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 20:34:21 (10377) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/08 20:34:21 (10377) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/08 20:34:21 (10377) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/08 20:39:22 (10437) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 20:39:22 (10437) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 20:39:22 (10437) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 20:39:22 (10437) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 20:43:23 (10474) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 20:44:23 (10481) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/08 20:44:23 (10481) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/08 20:44:23 (10481) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/08 20:49:24 (10496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/08 20:49:24 (10496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/08 20:49:24 (10496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/08 20:52:39 (10526) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 20:54:25 (10537) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/08 20:54:25 (10537) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/08 20:54:25 (10537) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/08 20:59:26 (10562) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/08 20:59:26 (10562) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/08 20:59:26 (10562) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/08 21:02:21 (10651) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:04:27 (10686) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/08 21:04:27 (10686) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/08 21:04:27 (10686) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/08 21:09:28 (10772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/08 21:09:28 (10772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/08 21:09:28 (10772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/08 21:13:07 (10805) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:14:29 (10813) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:14:29 (10813) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 21:14:29 (10813) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 21:14:29 (10813) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 21:19:30 (10833) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/08 21:19:30 (10833) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/08 21:19:30 (10833) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/08 21:22:40 (10861) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:24:31 (10871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:24:31 (10871) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 21:24:31 (10871) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 21:24:31 (10871) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 21:29:32 (10894) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/08 21:29:32 (10894) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/08 21:29:32 (10894) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/08 21:33:29 (10923) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:34:33 (10942) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:34:33 (10942) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 21:34:33 (10942) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 21:34:33 (10942) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 21:39:34 (11045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/08 21:39:34 (11045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/08 21:39:34 (11045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/08 21:42:58 (11073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:44:35 (11081) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/08 21:44:35 (11081) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/08 21:44:35 (11081) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/08 21:49:36 (11095) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/08 21:49:36 (11095) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/08 21:49:36 (11095) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/08 21:52:54 (11127) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:54:37 (11137) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 21:54:38 (11137) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 21:54:38 (11137) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 21:54:38 (11137) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 21:59:39 (11158) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/08 21:59:39 (11158) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/08 21:59:39 (11158) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/08 22:02:41 (11251) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:04:40 (11268) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:04:40 (11268) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 22:04:40 (11268) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 22:04:40 (11268) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 22:09:41 (11371) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/08 22:09:41 (11371) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/08 22:09:41 (11371) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/08 22:13:14 (11400) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:14:42 (11408) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:14:42 (11408) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 22:14:42 (11408) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 22:14:42 (11408) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 22:19:43 (11432) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/08 22:19:43 (11432) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/08 22:19:43 (11432) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/08 22:22:45 (11463) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:24:44 (11475) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/08 22:24:44 (11475) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/08 22:24:44 (11475) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/08 22:29:45 (11492) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/08 22:29:45 (11492) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/08 22:29:45 (11492) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/08 22:33:36 (11530) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:34:46 (11546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:34:46 (11546) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 22:34:46 (11546) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 22:34:46 (11546) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 22:39:47 (11628) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/08 22:39:47 (11628) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/08 22:39:47 (11628) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/08 22:44:17 (11680) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:44:48 (11687) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:44:48 (11687) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 22:44:48 (11687) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 22:44:48 (11687) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 22:49:49 (11703) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/08 22:49:49 (11703) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/08 22:49:49 (11703) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/08 22:54:50 (11737) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:54:51 (11743) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 22:54:51 (11743) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 22:54:51 (11743) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 22:54:51 (11743) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 22:59:52 (11759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/08 22:59:52 (11759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/08 22:59:52 (11759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/08 23:04:53 (11858) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 23:04:53 (11858) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 23:04:53 (11858) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 23:04:53 (11858) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 23:05:09 (11873) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 23:09:54 (11938) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/08 23:09:54 (11938) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/08 23:09:54 (11938) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/08 23:14:55 (12015) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 23:14:55 (12015) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/08 23:14:55 (12015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/08 23:14:55 (12015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/08 23:15:48 (12045) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 23:19:56 (12060) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/08 23:19:56 (12060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/08 23:19:56 (12060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/08 23:24:57 (12072) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/08 23:24:57 (12072) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/08 23:24:57 (12072) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/08 23:25:52 (12097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 23:29:59 (12119) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/08 23:29:59 (12119) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/08 23:29:59 (12119) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/08 23:34:59 (12158) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/08 23:34:59 (12158) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/08 23:34:59 (12158) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/08 23:36:05 (12202) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 23:40:00 (12222) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/08 23:40:00 (12222) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/08 23:40:00 (12222) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/08 23:45:01 (12308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/08 23:45:01 (12308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/08 23:45:01 (12308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/08 23:46:04 (12333) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/08 23:50:02 (12353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/08 23:50:02 (12353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/08 23:50:02 (12353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/08 23:55:03 (12438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/08 23:55:03 (12438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/08 23:55:03 (12438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/08 23:55:59 (12460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 00:00:04 (12524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/09 00:00:04 (12524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/09 00:00:04 (12524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/09 00:05:00 (12575) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 00:05:05 (12581) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/09 00:05:05 (12581) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/09 00:05:05 (12581) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/09 00:10:06 (12624) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/09 00:10:06 (12624) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/09 00:10:06 (12624) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/09 00:15:04 (12729) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 00:15:07 (12735) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/09 00:15:07 (12735) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/09 00:15:07 (12735) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/09 00:20:08 (12759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/09 00:20:08 (12759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/09 00:20:08 (12759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/09 00:24:47 (12791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 00:25:09 (12800) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/09 00:25:09 (12800) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/09 00:25:09 (12800) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/09 00:30:10 (12818) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/09 00:30:10 (12818) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/09 00:30:10 (12818) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/09 00:34:58 (12850) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 00:35:11 (12856) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/09 00:35:11 (12856) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/09 00:35:11 (12856) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/09 00:40:12 (12896) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/09 00:40:12 (12896) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/09 00:40:12 (12896) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/09 00:44:36 (12980) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 00:45:13 (12991) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/09 00:45:13 (12991) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/09 00:45:13 (12991) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/09 00:50:14 (13025) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/09 00:50:14 (13025) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/09 00:50:14 (13025) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/09 00:53:42 (13052) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 00:55:15 (13065) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/09 00:55:15 (13065) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/09 00:55:15 (13065) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/09 01:00:16 (13125) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/09 01:00:16 (13125) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/09 01:00:16 (13125) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/09 01:04:27 (13175) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 01:05:24 (13243) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/09 01:05:24 (13243) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/09 01:05:24 (13243) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/09 01:05:52 (13329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 01:10:25 (13378) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/09 01:10:25 (13378) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/09 01:10:25 (13378) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/09 01:15:09 (13466) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 01:15:26 (13474) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/09 01:15:26 (13474) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/09 01:15:26 (13474) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/09 01:20:27 (13509) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/09 01:20:27 (13509) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/09 01:20:27 (13509) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/09 01:25:28 (13524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/09 01:25:28 (13524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/09 01:25:28 (13524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/09 01:26:02 (13546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 01:30:29 (13560) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/09 01:30:29 (13560) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/09 01:30:29 (13560) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/09 01:35:30 (13573) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/09 01:35:30 (13573) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/09 01:35:30 (13573) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/09 01:36:31 (13615) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 01:40:31 (13644) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/09 01:40:31 (13644) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/09 01:40:31 (13644) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/09 01:45:32 (13697) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/09 01:45:32 (13697) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/09 01:45:32 (13697) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/09 01:47:24 (13742) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 01:50:33 (13774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/09 01:50:33 (13774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/09 01:50:33 (13774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/09 01:55:34 (13789) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/09 01:55:34 (13789) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/09 01:55:34 (13789) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/09 01:57:31 (13812) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 02:00:36 (13875) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/09 02:00:36 (13875) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/09 02:00:36 (13875) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/09 02:05:37 (13911) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/09 02:05:37 (13911) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/09 02:05:37 (13911) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/09 02:06:50 (13958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 02:10:38 (13985) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/09 02:10:38 (13985) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/09 02:10:38 (13985) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/09 02:15:39 (14000) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/09 02:15:39 (14000) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/09 02:15:39 (14000) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/09 02:16:22 (14060) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 02:20:40 (14116) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/09 02:20:40 (14116) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/09 02:20:40 (14116) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/09 02:25:41 (14128) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/09 02:25:41 (14128) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/09 02:25:41 (14128) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/09 02:27:21 (14154) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 02:30:42 (14228) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/09 02:30:42 (14228) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/09 02:30:42 (14228) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/09 02:35:43 (14246) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/09 02:35:43 (14246) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/09 02:35:43 (14246) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/09 02:36:26 (14279) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 02:40:44 (14308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/09 02:40:44 (14308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/09 02:40:44 (14308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/09 02:45:45 (14326) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/09 02:45:45 (14326) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/09 02:45:45 (14326) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/09 02:46:31 (14350) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 02:50:46 (14440) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/09 02:50:46 (14440) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/09 02:50:46 (14440) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/09 02:55:47 (14453) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/09 02:55:47 (14453) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/09 02:55:47 (14453) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/09 02:57:21 (14475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 03:00:48 (14537) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/09 03:00:48 (14537) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/09 03:00:48 (14537) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/09 03:05:49 (14579) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/09 03:05:49 (14579) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/09 03:05:49 (14579) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/09 03:07:55 (14623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 03:10:50 (14642) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/09 03:10:50 (14642) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/09 03:10:50 (14642) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/09 03:15:51 (14659) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/09 03:15:51 (14659) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/09 03:15:51 (14659) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/09 03:18:16 (14688) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 03:20:52 (14759) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/09 03:20:52 (14759) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/09 03:20:52 (14759) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/09 03:25:53 (14798) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/09 03:25:53 (14798) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/09 03:25:53 (14798) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/09 03:27:33 (14820) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 03:30:54 (14835) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/09 03:30:54 (14835) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/09 03:30:54 (14835) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/09 03:35:55 (14868) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/09 03:35:55 (14868) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/09 03:35:55 (14868) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/09 03:37:47 (14909) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 03:40:57 (14924) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/09 03:40:57 (14924) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/09 03:40:57 (14924) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/09 03:45:57 (14944) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/09 03:45:57 (14944) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/09 03:45:57 (14944) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/09 03:47:55 (14967) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 03:50:58 (15036) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/09 03:50:58 (15036) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/09 03:50:58 (15036) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/09 03:55:59 (15072) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/09 03:55:59 (15072) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/09 03:55:59 (15072) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/09 03:58:42 (15095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 04:01:00 (15158) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/09 04:01:00 (15158) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/09 04:01:00 (15158) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/09 04:06:01 (15195) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/09 04:06:01 (15195) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/09 04:06:01 (15195) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/09 04:09:11 (15243) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 04:11:02 (15255) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/09 04:11:02 (15255) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/09 04:11:02 (15255) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/09 04:16:03 (15276) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/09 04:16:03 (15276) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/09 04:16:03 (15276) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/09 04:19:54 (15307) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 04:21:04 (15353) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/09 04:21:04 (15353) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/09 04:21:04 (15353) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/09 04:26:05 (15407) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/09 04:26:05 (15407) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/09 04:26:05 (15407) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/09 04:30:26 (15442) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 04:31:06 (15449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/09 04:31:06 (15449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/09 04:31:06 (15449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/09 04:36:07 (15464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/09 04:36:07 (15464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/09 04:36:07 (15464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/09 04:40:24 (15543) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 04:41:08 (15550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/09 04:41:08 (15550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/09 04:41:08 (15550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/09 04:46:09 (15568) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/09 04:46:09 (15568) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/09 04:46:09 (15568) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/09 04:49:57 (15597) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 04:51:10 (15611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/09 04:51:10 (15611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/09 04:51:10 (15611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/09 04:56:11 (15728) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/09 04:56:11 (15728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/09 04:56:11 (15728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/09 04:59:26 (15765) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 05:01:12 (15842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/09 05:01:12 (15842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/09 05:01:12 (15842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/09 05:06:13 (15854) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/09 05:06:13 (15854) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/09 05:06:13 (15854) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/09 05:09:35 (15905) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 05:11:14 (16012) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/09 05:11:14 (16012) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/09 05:11:14 (16012) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/09 05:16:15 (16190) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/09 05:16:15 (16190) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/09 05:16:15 (16190) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/09 05:19:18 (16222) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 05:21:16 (16234) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/09 05:21:16 (16234) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/09 05:21:16 (16234) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/09 05:26:18 (16327) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/09 05:26:18 (16327) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/09 05:26:18 (16327) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/09 05:29:55 (16357) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 05:31:18 (16368) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/09 05:31:18 (16368) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/09 05:31:18 (16368) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/09 05:36:19 (16379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/09 05:36:19 (16379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/09 05:36:19 (16379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/09 05:39:49 (16427) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 05:41:20 (16439) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/09 05:41:20 (16439) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/09 05:41:20 (16439) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/09 05:46:21 (16454) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/09 05:46:21 (16454) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/09 05:46:21 (16454) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/09 05:49:44 (16485) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 05:51:22 (16497) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/09 05:51:22 (16497) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/09 05:51:22 (16497) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/09 05:56:23 (16565) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/09 05:56:23 (16565) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/09 05:56:23 (16565) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/09 06:00:44 (16668) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 06:01:24 (16692) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/09 06:01:24 (16692) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/09 06:01:24 (16692) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/09 06:06:25 (16705) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/09 06:06:25 (16705) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/09 06:06:25 (16705) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/09 06:10:40 (16761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 06:11:26 (16768) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/09 06:11:26 (16768) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/09 06:11:26 (16768) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/09 06:16:27 (16784) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/09 06:16:27 (16784) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/09 06:16:27 (16784) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/09 06:19:43 (16818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 06:21:28 (16830) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/09 06:21:28 (16830) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/09 06:21:28 (16830) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/09 06:26:29 (16886) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/09 06:26:29 (16886) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/09 06:26:29 (16886) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/09 06:30:27 (16958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 06:31:30 (16965) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/09 06:31:30 (16965) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/09 06:31:30 (16965) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/09 06:36:31 (16976) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/09 06:36:31 (16976) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/09 06:36:31 (16976) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/09 06:41:16 (17043) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 06:41:32 (17049) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/09 06:41:32 (17049) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/09 06:41:32 (17049) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/09 06:46:33 (17062) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/09 06:46:33 (17062) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/09 06:46:33 (17062) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/09 06:51:34 (17083) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/09 06:51:34 (17083) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/09 06:51:34 (17083) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/09 06:52:02 (17108) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 06:56:35 (17139) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/09 06:56:35 (17139) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/09 06:56:35 (17139) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/09 07:01:36 (17280) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/09 07:01:36 (17280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/09 07:01:36 (17280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/09 07:02:32 (17302) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 07:06:37 (17318) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/09 07:06:37 (17318) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/09 07:06:37 (17318) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/09 07:11:37 (17379) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 07:11:38 (17385) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/09 07:11:38 (17385) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/09 07:11:38 (17385) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/09 07:16:40 (17429) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/09 07:16:40 (17429) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/09 07:16:40 (17429) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/09 07:20:41 (17461) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 07:21:40 (17468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/09 07:21:40 (17468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/09 07:21:40 (17468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/09 07:26:41 (17479) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/09 07:26:41 (17479) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/09 07:26:41 (17479) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/09 07:31:24 (17593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 07:31:42 (17599) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/09 07:31:42 (17599) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/09 07:31:42 (17599) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/09 07:36:43 (17637) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/09 07:36:43 (17637) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/09 07:36:43 (17637) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/09 07:41:27 (17693) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 07:41:44 (17700) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/09 07:41:44 (17700) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/09 07:41:44 (17700) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/09 07:46:45 (17715) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/09 07:46:45 (17715) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/09 07:46:45 (17715) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/09 07:50:51 (17746) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 07:51:46 (17753) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/09 07:51:46 (17753) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/09 07:51:46 (17753) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/09 07:56:47 (17826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/09 07:56:47 (17826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/09 07:56:47 (17826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/09 08:00:29 (17961) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 08:01:48 (17989) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/09 08:01:48 (17989) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/09 08:01:48 (17989) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/09 08:06:49 (18021) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/09 08:06:49 (18021) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/09 08:06:49 (18021) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/09 08:11:09 (18078) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 08:11:50 (18084) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/09 08:11:50 (18084) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/09 08:11:50 (18084) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/09 08:16:51 (18103) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/09 08:16:51 (18103) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/09 08:16:51 (18103) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/09 08:21:09 (18136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 08:21:52 (18142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/09 08:21:52 (18142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/09 08:21:52 (18142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/09 08:26:53 (18154) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/09 08:26:53 (18154) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/09 08:26:53 (18154) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/09 08:30:17 (18203) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 08:31:54 (18252) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/09 08:31:54 (18252) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/09 08:31:54 (18252) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/09 08:36:55 (18287) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/09 08:36:55 (18287) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/09 08:36:55 (18287) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/09 08:40:31 (18335) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 08:41:56 (18349) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/09 08:41:56 (18349) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/09 08:41:56 (18349) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/09 08:46:57 (18359) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/09 08:46:57 (18359) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/09 08:46:57 (18359) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/09 08:51:07 (18396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 08:51:58 (18402) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/09 08:51:58 (18402) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/09 08:51:58 (18402) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/09 08:56:59 (18414) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/09 08:56:59 (18414) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/09 08:56:59 (18414) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/09 09:00:24 (18490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 09:02:00 (18555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/09 09:02:00 (18555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/09 09:02:00 (18555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/09 09:07:01 (18618) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/09 09:07:01 (18618) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/09 09:07:01 (18618) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/09 09:10:40 (18670) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 09:12:02 (18679) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/09 09:12:02 (18679) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/09 09:12:02 (18679) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/09 09:17:03 (18698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/09 09:17:03 (18698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/09 09:17:03 (18698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/09 09:21:28 (18728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 09:22:04 (18734) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/09 09:22:04 (18734) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/09 09:22:04 (18734) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/09 09:27:05 (18747) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/09 09:27:05 (18747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/09 09:27:05 (18747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/09 09:32:06 (18785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/09 09:32:06 (18785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/09 09:32:06 (18785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/09 09:32:09 (18787) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 09:37:07 (18881) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/09 09:37:07 (18881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/09 09:37:07 (18881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/09 09:41:46 (18934) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 09:42:08 (18943) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/09 09:42:08 (18943) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/09 09:42:08 (18943) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/09 09:47:09 (18957) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/09 09:47:09 (18957) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/09 09:47:09 (18957) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/09 09:52:09 (18990) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 09:52:10 (18996) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/09 09:52:10 (18996) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/09 09:52:10 (18996) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/09 09:57:11 (19008) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/09 09:57:11 (19008) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/09 09:57:11 (19008) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/09 10:01:51 (19105) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 10:02:12 (19112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/09 10:02:12 (19112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/09 10:02:12 (19112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/09 10:07:13 (19207) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/09 10:07:13 (19207) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/09 10:07:13 (19207) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/09 10:11:46 (19265) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 10:12:14 (19278) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/09 10:12:14 (19278) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/09 10:12:14 (19278) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/09 10:17:15 (19293) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/09 10:17:15 (19293) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/09 10:17:15 (19293) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/09 10:22:00 (19322) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 10:22:16 (19329) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/09 10:22:16 (19329) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/09 10:22:16 (19329) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/09 10:27:17 (19342) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/09 10:27:17 (19342) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/09 10:27:17 (19342) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/09 10:31:33 (19373) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 10:32:18 (19380) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/09 10:32:18 (19380) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/09 10:32:18 (19380) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/09 10:37:19 (19456) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/09 10:37:19 (19456) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/09 10:37:19 (19456) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/09 10:40:50 (19519) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 10:42:20 (19533) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/09 10:42:20 (19533) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/09 10:42:20 (19533) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/09 10:47:21 (19547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/09 10:47:21 (19547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/09 10:47:21 (19547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/09 10:51:14 (19576) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 10:52:22 (19583) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/09 10:52:22 (19583) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/09 10:52:22 (19583) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/09 10:57:23 (19597) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/09 10:57:23 (19597) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/09 10:57:23 (19597) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/09 11:00:57 (19671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 11:02:24 (19696) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/09 11:02:24 (19696) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/09 11:02:24 (19696) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/09 11:07:26 (19769) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/09 11:07:26 (19769) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/09 11:07:26 (19769) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/09 11:10:27 (19839) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 11:12:27 (19849) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/09 11:12:27 (19849) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/09 11:12:27 (19849) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/09 11:17:28 (19878) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/09 11:17:28 (19878) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/09 11:17:28 (19878) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/09 11:20:48 (19906) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 11:22:29 (19914) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/09 11:22:29 (19914) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/09 11:22:29 (19914) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/09 11:27:30 (19926) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/09 11:27:30 (19926) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/09 11:27:30 (19926) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/09 11:31:20 (19959) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 11:32:31 (19969) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/09 11:32:31 (19969) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/09 11:32:31 (19969) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/09 11:37:32 (20020) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/09 11:37:32 (20020) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/09 11:37:32 (20020) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/09 11:41:10 (20106) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 11:42:33 (20119) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/09 11:42:33 (20119) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/09 11:42:33 (20119) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/09 11:47:34 (20131) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/09 11:47:34 (20131) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/09 11:47:34 (20131) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/09 11:51:07 (20164) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 11:52:35 (20172) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/09 11:52:35 (20172) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/09 11:52:35 (20172) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/09 11:57:36 (20185) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/09 11:57:36 (20185) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/09 11:57:36 (20185) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/09 12:01:51 (20284) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 12:02:37 (20291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/09 12:02:37 (20291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/09 12:02:37 (20291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/09 12:07:38 (20307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/09 12:07:38 (20307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/09 12:07:38 (20307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/09 12:11:22 (20432) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 12:12:39 (20443) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/09 12:12:39 (20443) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/09 12:12:39 (20443) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/09 12:17:40 (20459) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/09 12:17:40 (20459) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/09 12:17:40 (20459) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/09 12:22:05 (20494) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 12:22:41 (20501) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/09 12:22:41 (20501) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/09 12:22:41 (20501) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/09 12:27:42 (20512) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/09 12:27:42 (20512) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/09 12:27:42 (20512) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/09 12:32:08 (20549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 12:32:43 (20556) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/09 12:32:43 (20556) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/09 12:32:43 (20556) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/09 12:37:44 (20567) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/09 12:37:44 (20567) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/09 12:37:44 (20567) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/09 12:41:40 (20678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 12:42:45 (20707) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/09 12:42:45 (20707) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/09 12:42:45 (20707) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/09 12:47:47 (20717) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/09 12:47:47 (20717) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/09 12:47:47 (20717) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/09 12:51:45 (20753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 12:52:48 (20760) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/09 12:52:48 (20760) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/09 12:52:48 (20760) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/09 12:57:49 (20772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/09 12:57:49 (20772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/09 12:57:49 (20772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/09 13:01:44 (20870) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 13:02:50 (20877) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/09 13:02:50 (20877) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/09 13:02:50 (20877) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/09 13:07:51 (20888) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/09 13:07:51 (20888) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/09 13:07:51 (20888) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/09 13:11:54 (20983) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 13:12:52 (21011) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/09 13:12:52 (21011) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/09 13:12:52 (21011) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/09 13:17:53 (21046) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/09 13:17:53 (21046) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/09 13:17:53 (21046) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/09 13:21:58 (21083) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 13:22:54 (21090) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/09 13:22:54 (21090) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/09 13:22:54 (21090) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/09 13:27:55 (21099) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/09 13:27:55 (21099) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/09 13:27:55 (21099) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/09 13:32:42 (21140) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 13:32:56 (21146) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/09 13:32:56 (21146) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/09 13:32:56 (21146) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/09 13:37:57 (21156) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/09 13:37:57 (21156) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/09 13:37:57 (21156) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/09 13:42:58 (21251) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/09 13:42:58 (21251) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/09 13:42:58 (21251) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/09 13:43:13 (21268) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 13:47:59 (21305) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/09 13:47:59 (21305) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/09 13:47:59 (21305) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/09 13:53:00 (21324) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/09 13:53:00 (21324) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/09 13:53:00 (21324) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/09 13:53:36 (21346) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 13:58:01 (21356) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/09 13:58:01 (21356) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/09 13:58:01 (21356) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/09 14:03:02 (21443) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/09 14:03:02 (21443) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/09 14:03:02 (21443) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/09 14:03:39 (21465) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 14:08:03 (21475) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/09 14:08:03 (21475) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/09 14:08:03 (21475) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/09 14:13:04 (21538) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/09 14:13:04 (21538) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/09 14:13:04 (21538) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/09 14:13:24 (21581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 14:18:05 (21637) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/09 14:18:05 (21637) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/09 14:18:05 (21637) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/09 14:23:06 (21656) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/09 14:23:06 (21656) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/09 14:23:06 (21656) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/09 14:24:22 (21679) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 14:28:07 (21688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/09 14:28:07 (21688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/09 14:28:07 (21688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/09 14:33:08 (21711) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/09 14:33:08 (21711) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/09 14:33:08 (21711) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/09 14:33:35 (21734) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 14:38:10 (21744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/09 14:38:10 (21744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/09 14:38:10 (21744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/09 14:43:11 (21787) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/09 14:43:11 (21787) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/09 14:43:11 (21787) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/09 14:44:01 (21814) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 14:48:12 (21906) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/09 14:48:12 (21906) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/09 14:48:12 (21906) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/09 14:53:04 (21944) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 14:53:13 (21950) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/09 14:53:13 (21950) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/09 14:53:13 (21950) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/09 14:58:14 (21956) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/09 14:58:14 (21956) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/09 14:58:14 (21956) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/09 15:03:15 (22040) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/09 15:03:15 (22040) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/09 15:03:15 (22040) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/09 15:03:39 (22062) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 15:08:16 (22076) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/09 15:08:16 (22076) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/09 15:08:16 (22076) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/09 15:13:17 (22141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/09 15:13:17 (22141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/09 15:13:17 (22141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/09 15:13:23 (22143) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 15:18:18 (22245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/09 15:18:18 (22245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/09 15:18:18 (22245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/09 15:22:41 (22301) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 15:23:19 (22307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/09 15:23:19 (22307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/09 15:23:19 (22307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/09 15:28:20 (22315) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/09 15:28:20 (22315) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/09 15:28:20 (22315) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/09 15:33:21 (22354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/09 15:33:21 (22354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/09 15:33:21 (22354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/09 15:33:23 (22355) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 15:38:22 (22393) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/09 15:38:22 (22393) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/09 15:38:22 (22393) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/09 15:43:23 (22428) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/09 15:43:23 (22428) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/09 15:43:23 (22428) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/09 15:43:45 (22450) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 15:48:24 (22524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/09 15:48:24 (22524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/09 15:48:24 (22524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/09 15:53:25 (22586) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/09 15:53:25 (22586) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/09 15:53:25 (22586) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/09 15:54:26 (22637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 15:58:26 (22664) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/09 15:58:26 (22664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/09 15:58:26 (22664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/09 16:03:27 (22745) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/09 16:03:27 (22745) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/09 16:03:27 (22745) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/09 16:05:21 (22767) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 16:08:29 (22780) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/09 16:08:29 (22780) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/09 16:08:29 (22780) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/09 16:13:29 (22822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/09 16:13:29 (22822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/09 16:13:29 (22822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/09 16:15:19 (22848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 16:18:30 (22899) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/09 16:18:30 (22899) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/09 16:18:30 (22899) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/09 16:23:31 (22957) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/09 16:23:31 (22957) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/09 16:23:31 (22957) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/09 16:25:31 (22980) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 16:28:32 (22989) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/09 16:28:32 (22989) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/09 16:28:32 (22989) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/09 16:33:33 (23014) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/09 16:33:33 (23014) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/09 16:33:33 (23014) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/09 16:34:30 (23036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 16:38:34 (23046) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/09 16:38:34 (23046) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/09 16:38:34 (23046) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/09 16:43:35 (23087) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/09 16:43:35 (23087) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/09 16:43:35 (23087) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/09 16:44:35 (23109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 16:48:36 (23128) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/09 16:48:36 (23128) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/09 16:48:36 (23128) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/09 16:53:37 (23219) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/09 16:53:37 (23219) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/09 16:53:37 (23219) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/09 16:54:41 (23241) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 16:58:38 (23258) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/09 16:58:38 (23258) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/09 16:58:38 (23258) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/09 17:03:39 (23336) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/09 17:03:39 (23336) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/09 17:03:39 (23336) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/09 17:04:45 (23358) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 17:08:40 (23374) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/09 17:08:40 (23374) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/09 17:08:40 (23374) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/09 17:13:41 (23414) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/09 17:13:41 (23414) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/09 17:13:41 (23414) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/09 17:14:19 (23435) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 17:18:42 (23455) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/09 17:18:42 (23455) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/09 17:18:42 (23455) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/09 17:23:43 (23569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/09 17:23:43 (23569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/09 17:23:43 (23569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/09 17:23:44 (23570) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 17:28:44 (23586) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/09 17:28:44 (23586) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/09 17:28:44 (23586) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/09 17:32:52 (23620) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 17:33:45 (23627) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/09 17:33:45 (23627) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/09 17:33:45 (23627) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/09 17:38:46 (23639) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/09 17:38:46 (23639) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/09 17:38:46 (23639) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/09 17:42:40 (23687) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 17:43:47 (23701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/09 17:43:47 (23701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/09 17:43:47 (23701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/09 17:48:48 (23713) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/09 17:48:48 (23713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/09 17:48:48 (23713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/09 17:52:49 (23801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 17:53:49 (23815) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/09 17:53:49 (23815) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/09 17:53:49 (23815) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/09 17:58:50 (23850) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/09 17:58:50 (23850) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/09 17:58:50 (23850) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/09 18:01:54 (23943) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 18:03:51 (23953) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/09 18:03:51 (23953) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/09 18:03:51 (23953) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/09 18:08:52 (23962) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/09 18:08:52 (23962) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/09 18:08:52 (23962) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/09 18:11:28 (24001) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 18:13:53 (24031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/09 18:13:53 (24031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/09 18:13:53 (24031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/09 18:18:54 (24046) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/09 18:18:54 (24046) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/09 18:18:54 (24046) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/09 18:22:18 (24080) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 18:23:55 (24143) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/09 18:23:55 (24143) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/09 18:23:55 (24143) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/09 18:28:56 (24176) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/09 18:28:56 (24176) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/09 18:28:56 (24176) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/09 18:32:22 (24211) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 18:33:57 (24221) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/09 18:33:57 (24221) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/09 18:33:57 (24221) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/09 18:38:58 (24234) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/09 18:38:58 (24234) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/09 18:38:58 (24234) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/09 18:43:14 (24285) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 18:43:59 (24292) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/09 18:43:59 (24292) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/09 18:43:59 (24292) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/09 18:49:00 (24310) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/09 18:49:00 (24310) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/09 18:49:00 (24310) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/09 18:54:01 (24380) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/09 18:54:01 (24380) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/09 18:54:01 (24380) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/09 18:54:07 (24381) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 18:59:02 (24437) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/09 18:59:02 (24437) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/09 18:59:02 (24437) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/09 19:03:33 (24540) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 19:04:03 (24547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/09 19:04:03 (24547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/09 19:04:03 (24547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/09 19:09:04 (24558) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/09 19:09:04 (24558) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/09 19:09:04 (24558) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/09 19:13:03 (24610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 19:14:05 (24619) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/09 19:14:05 (24619) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/09 19:14:05 (24619) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/09 19:19:06 (24641) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/09 19:19:06 (24641) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/09 19:19:06 (24641) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/09 19:23:01 (24673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 19:24:07 (24683) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/09 19:24:07 (24683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/09 19:24:07 (24683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/09 19:29:08 (24769) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/09 19:29:08 (24769) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/09 19:29:08 (24769) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/09 19:33:43 (24808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 19:34:09 (24814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/09 19:34:09 (24814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/09 19:34:09 (24814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/09 19:39:10 (24827) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/09 19:39:10 (24827) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/09 19:39:10 (24827) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/09 19:43:51 (24878) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 19:44:11 (24884) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/09 19:44:11 (24884) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/09 19:44:11 (24884) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/09 19:49:12 (24903) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/09 19:49:12 (24903) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/09 19:49:12 (24903) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/09 19:53:20 (24934) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 19:54:13 (24941) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/09 19:54:13 (24941) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/09 19:54:13 (24941) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/09 19:59:15 (25035) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/09 19:59:15 (25035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/09 19:59:15 (25035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/09 20:04:12 (25133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 20:04:15 (25139) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/09 20:04:15 (25139) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/09 20:04:15 (25139) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/09 20:09:16 (25155) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/09 20:09:16 (25155) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/09 20:09:16 (25155) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/09 20:14:12 (25209) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 20:14:17 (25215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/09 20:14:17 (25215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/09 20:14:17 (25215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/09 20:19:18 (25233) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/09 20:19:18 (25233) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/09 20:19:18 (25233) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/09 20:23:40 (25269) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 20:24:19 (25276) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/09 20:24:19 (25276) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/09 20:24:19 (25276) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/09 20:29:20 (25346) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/09 20:29:20 (25346) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/09 20:29:20 (25346) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/09 20:33:23 (25404) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 20:34:21 (25411) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/09 20:34:21 (25411) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/09 20:34:21 (25411) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/09 20:39:22 (25422) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/09 20:39:22 (25422) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/09 20:39:22 (25422) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/09 20:43:44 (25472) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 20:44:23 (25480) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/09 20:44:23 (25480) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/09 20:44:23 (25480) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/09 20:49:24 (25496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/09 20:49:24 (25496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/09 20:49:24 (25496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/09 20:54:25 (25533) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/09 20:54:25 (25533) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/09 20:54:25 (25533) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/09 20:54:28 (25534) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 20:59:26 (25591) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/09 20:59:26 (25591) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/09 20:59:26 (25591) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/09 21:04:27 (25713) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/09 21:04:27 (25713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/09 21:04:27 (25713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/09 21:05:12 (25735) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 21:09:28 (25751) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/09 21:09:28 (25751) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/09 21:09:28 (25751) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/09 21:14:29 (25784) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/09 21:14:29 (25784) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/09 21:14:29 (25784) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/09 21:15:15 (25806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 21:19:30 (25826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/09 21:19:30 (25826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/09 21:19:30 (25826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/09 21:24:31 (25842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/09 21:24:31 (25842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/09 21:24:31 (25842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/09 21:25:01 (25864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 21:29:32 (25899) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/09 21:29:32 (25899) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/09 21:29:32 (25899) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/09 21:34:01 (25999) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 21:34:33 (26005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/09 21:34:33 (26005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/09 21:34:33 (26005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/09 21:39:34 (26015) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/09 21:39:34 (26015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/09 21:39:34 (26015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/09 21:43:52 (26068) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 21:44:35 (26076) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/09 21:44:35 (26076) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/09 21:44:35 (26076) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/09 21:49:37 (26088) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/09 21:49:37 (26088) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/09 21:49:37 (26088) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/09 21:53:11 (26123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 21:54:37 (26130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/09 21:54:37 (26130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/09 21:54:37 (26130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/09 21:59:38 (26152) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/09 21:59:38 (26152) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/09 21:59:38 (26152) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/09 22:03:48 (26327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 22:04:39 (26334) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/09 22:04:39 (26334) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/09 22:04:39 (26334) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/09 22:09:40 (26346) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/09 22:09:40 (26346) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/09 22:09:40 (26346) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/09 22:14:27 (26401) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 22:14:41 (26407) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/09 22:14:41 (26407) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/09 22:14:41 (26407) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/09 22:19:42 (26421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/09 22:19:42 (26421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/09 22:19:42 (26421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/09 22:24:32 (26458) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 22:24:43 (26464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/09 22:24:43 (26464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/09 22:24:43 (26464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/09 22:29:44 (26479) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/09 22:29:44 (26479) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/09 22:29:44 (26479) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/09 22:34:02 (26569) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 22:34:45 (26597) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/09 22:34:45 (26597) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/09 22:34:45 (26597) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/09 22:39:46 (26611) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/09 22:39:46 (26611) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/09 22:39:46 (26611) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/09 22:44:47 (26665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/09 22:44:47 (26665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/09 22:44:47 (26665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/09 22:44:48 (26666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 22:49:48 (26684) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/09 22:49:48 (26684) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/09 22:49:48 (26684) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/09 22:54:49 (26700) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/09 22:54:49 (26700) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/09 22:54:49 (26700) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/09 22:55:40 (26725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 22:59:50 (26749) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/09 22:59:50 (26749) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/09 22:59:50 (26749) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/09 23:04:51 (26880) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/09 23:04:51 (26880) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/09 23:04:51 (26880) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/09 23:06:39 (26924) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 23:09:52 (26942) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/09 23:09:52 (26942) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/09 23:09:52 (26942) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/09 23:14:53 (26977) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/09 23:14:53 (26977) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/09 23:14:53 (26977) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/09 23:15:45 (27002) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 23:19:54 (27043) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/09 23:19:54 (27043) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/09 23:19:54 (27043) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/09 23:24:55 (27060) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/09 23:24:55 (27060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/09 23:24:55 (27060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/09 23:25:37 (27081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 23:29:56 (27094) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/09 23:29:56 (27094) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/09 23:29:56 (27094) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/09 23:34:40 (27169) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 23:34:57 (27176) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/09 23:34:57 (27176) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/09 23:34:57 (27176) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/09 23:39:58 (27244) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/09 23:39:58 (27244) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/09 23:39:58 (27244) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/09 23:44:30 (27297) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 23:44:59 (27309) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/09 23:44:59 (27309) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/09 23:44:59 (27309) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/09 23:50:00 (27318) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/09 23:50:00 (27318) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/09 23:50:00 (27318) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/09 23:54:35 (27389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/09 23:55:02 (27412) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/09 23:55:02 (27412) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/09 23:55:02 (27412) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/10 00:00:03 (27496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/10 00:00:03 (27496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/10 00:00:03 (27496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/10 00:04:12 (27547) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 00:05:04 (27557) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/10 00:05:04 (27557) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/10 00:05:04 (27557) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/10 00:10:05 (27652) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/10 00:10:05 (27652) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/10 00:10:05 (27652) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/10 00:15:04 (27707) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 00:15:06 (27713) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/10 00:15:06 (27713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/10 00:15:06 (27713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/10 00:20:07 (27729) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/10 00:20:07 (27729) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/10 00:20:07 (27729) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/10 00:25:08 (27744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/10 00:25:08 (27744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/10 00:25:08 (27744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/10 00:25:32 (27765) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 00:30:09 (27782) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/10 00:30:09 (27782) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/10 00:30:09 (27782) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/10 00:34:50 (27818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 00:35:10 (27825) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/10 00:35:10 (27825) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/10 00:35:10 (27825) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/10 00:40:11 (27914) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/10 00:40:11 (27914) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/10 00:40:11 (27914) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/10 00:43:52 (27953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 00:45:12 (27979) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/10 00:45:12 (27979) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/10 00:45:12 (27979) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/10 00:50:13 (27989) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/10 00:50:13 (27989) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/10 00:50:13 (27989) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/10 00:54:48 (28038) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 00:55:14 (28045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/10 00:55:14 (28045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/10 00:55:14 (28045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/10 01:00:15 (28112) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/10 01:00:15 (28112) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/10 01:00:15 (28112) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/10 01:04:07 (28172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 01:05:24 (28239) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/10 01:05:24 (28239) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/10 01:05:24 (28239) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/10 01:06:17 (28320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 01:10:25 (28412) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/10 01:10:25 (28412) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/10 01:10:25 (28412) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/10 01:15:26 (28480) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/10 01:15:26 (28480) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/10 01:15:26 (28480) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/10 01:15:44 (28481) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 01:20:27 (28504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/10 01:20:27 (28504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/10 01:20:27 (28504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/10 01:25:28 (28510) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/10 01:25:28 (28510) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/10 01:25:28 (28510) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/10 01:25:58 (28535) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 01:30:29 (28555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/10 01:30:29 (28555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/10 01:30:29 (28555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/10 01:35:30 (28566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/10 01:35:30 (28566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/10 01:35:30 (28566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/10 01:36:38 (28592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 01:40:31 (28671) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/10 01:40:31 (28671) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/10 01:40:31 (28671) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/10 01:45:32 (28721) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/10 01:45:32 (28721) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/10 01:45:32 (28721) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/10 01:46:25 (28746) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 01:50:33 (28763) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/10 01:50:33 (28763) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/10 01:50:33 (28763) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/10 01:55:34 (28772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/10 01:55:34 (28772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/10 01:55:34 (28772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/10 01:57:08 (28797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 02:00:35 (28863) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/10 02:00:35 (28863) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/10 02:00:35 (28863) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/10 02:05:36 (28895) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/10 02:05:36 (28895) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/10 02:05:36 (28895) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/10 02:07:51 (28931) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 02:10:37 (28993) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/10 02:10:37 (28993) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/10 02:10:37 (28993) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/10 02:15:38 (29058) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/10 02:15:38 (29058) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/10 02:15:38 (29058) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/10 02:18:20 (29089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 02:20:39 (29101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/10 02:20:39 (29101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/10 02:20:39 (29101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/10 02:25:41 (29107) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/10 02:25:41 (29107) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/10 02:25:41 (29107) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/10 02:28:24 (29139) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 02:30:41 (29212) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/10 02:30:41 (29212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/10 02:30:41 (29212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/10 02:35:42 (29229) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/10 02:35:42 (29229) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/10 02:35:42 (29229) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/10 02:37:55 (29257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 02:40:43 (29277) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/10 02:40:43 (29277) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/10 02:40:43 (29277) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/10 02:45:44 (29378) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/10 02:45:44 (29378) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/10 02:45:44 (29378) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/10 02:47:00 (29404) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 02:50:45 (29422) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/10 02:50:45 (29422) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/10 02:50:45 (29422) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/10 02:55:46 (29430) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/10 02:55:46 (29430) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/10 02:55:46 (29430) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/10 02:57:08 (29453) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 03:00:47 (29516) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/10 03:00:47 (29516) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/10 03:00:47 (29516) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/10 03:05:48 (29554) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/10 03:05:48 (29554) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/10 03:05:48 (29554) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/10 03:06:44 (29583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 03:10:49 (29603) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/10 03:10:49 (29603) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/10 03:10:49 (29603) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/10 03:15:50 (29708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/10 03:15:50 (29708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/10 03:15:50 (29708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/10 03:17:00 (29738) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 03:20:51 (29769) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/10 03:20:51 (29769) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/10 03:20:51 (29769) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/10 03:25:52 (29781) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/10 03:25:52 (29781) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/10 03:25:52 (29781) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/10 03:27:37 (29804) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 03:30:53 (29820) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/10 03:30:53 (29820) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/10 03:30:53 (29820) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/10 03:35:54 (29842) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/10 03:35:54 (29842) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/10 03:35:54 (29842) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/10 03:38:25 (29870) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 03:40:55 (29886) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/10 03:40:55 (29886) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/10 03:40:55 (29886) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/10 03:45:56 (29971) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/10 03:45:56 (29971) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/10 03:45:56 (29971) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/10 03:49:08 (30015) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 03:50:57 (30403) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/10 03:50:57 (30403) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/10 03:50:57 (30403) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/10 03:55:58 (30415) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/10 03:55:58 (30415) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/10 03:55:58 (30415) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/10 03:59:24 (30443) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 04:00:59 (30531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/10 04:00:59 (30531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/10 04:00:59 (30531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/10 04:06:00 (30570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/10 04:06:00 (30570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/10 04:06:00 (30570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/10 04:09:11 (30598) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 04:11:01 (30642) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/10 04:11:01 (30642) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/10 04:11:01 (30642) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/10 04:16:02 (30725) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/10 04:16:02 (30725) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/10 04:16:02 (30725) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/10 04:19:32 (30783) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 04:21:04 (30794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/10 04:21:04 (30794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/10 04:21:04 (30794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/10 04:26:04 (30804) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/10 04:26:04 (30804) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/10 04:26:04 (30804) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/10 04:30:21 (30837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 04:31:05 (30843) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/10 04:31:05 (30843) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/10 04:31:05 (30843) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/10 04:36:06 (30861) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/10 04:36:06 (30861) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/10 04:36:06 (30861) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/10 04:41:07 (30900) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/10 04:41:07 (30900) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/10 04:41:07 (30900) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/10 04:41:20 (30903) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 04:46:08 (30971) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/10 04:46:08 (30971) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/10 04:46:08 (30971) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/10 04:51:09 (31027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/10 04:51:09 (31027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/10 04:51:09 (31027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/10 04:52:07 (31048) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 04:56:10 (31067) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/10 04:56:10 (31067) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/10 04:56:10 (31067) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/10 05:01:11 (31139) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/10 05:01:11 (31139) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/10 05:01:11 (31139) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/10 05:02:45 (31161) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 05:06:12 (31186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/10 05:06:12 (31186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/10 05:06:12 (31186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/10 05:11:13 (31199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/10 05:11:13 (31199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/10 05:11:13 (31199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/10 05:12:08 (31224) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 05:16:14 (31266) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/10 05:16:14 (31266) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/10 05:16:14 (31266) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/10 05:21:15 (31358) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/10 05:21:15 (31358) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/10 05:21:15 (31358) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/10 05:22:33 (31380) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 05:26:16 (31399) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/10 05:26:16 (31399) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/10 05:26:16 (31399) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/10 05:31:17 (31411) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/10 05:31:17 (31411) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/10 05:31:17 (31411) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/10 05:32:01 (31432) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 05:36:18 (31460) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/10 05:36:18 (31460) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/10 05:36:18 (31460) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/10 05:41:16 (31494) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 05:41:19 (31500) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/10 05:41:19 (31500) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/10 05:41:19 (31500) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/10 05:46:20 (31532) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/10 05:46:20 (31532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/10 05:46:20 (31532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/10 05:50:25 (31618) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 05:51:21 (31647) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/10 05:51:21 (31647) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/10 05:51:21 (31647) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/10 05:56:22 (31662) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/10 05:56:22 (31662) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/10 05:56:22 (31662) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/10 06:00:41 (31739) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 06:01:23 (31763) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/10 06:01:23 (31763) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/10 06:01:23 (31763) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/10 06:06:24 (31785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/10 06:06:24 (31785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/10 06:06:24 (31785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/10 06:11:26 (31823) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/10 06:11:26 (31823) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/10 06:11:26 (31823) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/10 06:11:31 (31824) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 06:16:26 (31858) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/10 06:16:26 (31858) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/10 06:16:26 (31858) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/10 06:21:27 (31953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 06:21:28 (31959) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/10 06:21:28 (31959) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/10 06:21:28 (31959) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/10 06:26:29 (31999) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/10 06:26:29 (31999) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/10 06:26:29 (31999) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/10 06:31:30 (32031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/10 06:31:30 (32031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/10 06:31:30 (32031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/10 06:31:36 (32032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 06:36:31 (32062) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/10 06:36:31 (32062) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/10 06:36:31 (32062) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/10 06:41:32 (32072) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/10 06:41:32 (32072) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/10 06:41:32 (32072) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/10 06:42:14 (32095) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 06:46:33 (32129) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/10 06:46:33 (32129) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/10 06:46:33 (32129) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/10 06:51:17 (32199) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 06:51:34 (32207) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/10 06:51:34 (32207) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/10 06:51:34 (32207) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/10 06:56:35 (32259) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/10 06:56:35 (32259) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/10 06:56:35 (32259) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/10 07:01:36 (32362) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/10 07:01:36 (32362) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/10 07:01:36 (32362) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/10 07:01:40 (32363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 07:06:37 (32390) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/10 07:06:37 (32390) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/10 07:06:37 (32390) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/10 07:11:38 (32421) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/10 07:11:38 (32421) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/10 07:11:38 (32421) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/10 07:11:49 (32422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 07:16:39 (32460) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/10 07:16:39 (32460) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/10 07:16:39 (32460) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/10 07:21:40 (32531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/10 07:21:40 (32531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/10 07:21:40 (32531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/10 07:21:54 (32538) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 07:26:41 (32620) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/10 07:26:41 (32620) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/10 07:26:41 (32620) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/10 07:31:42 (32650) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/10 07:31:42 (32650) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/10 07:31:42 (32650) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/10 07:31:43 (32651) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 07:36:43 (32677) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/10 07:36:43 (32677) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/10 07:36:43 (32677) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/10 07:41:44 (32720) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/10 07:41:44 (32720) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/10 07:41:44 (32720) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/10 07:42:05 (32744) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 07:46:45 (308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/10 07:46:45 (308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/10 07:46:45 (308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/10 07:51:46 (325) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/10 07:51:46 (325) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/10 07:51:46 (325) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/10 07:52:17 (354) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 07:56:47 (496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/10 07:56:47 (496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/10 07:56:47 (496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/10 08:01:40 (598) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 08:01:49 (604) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/10 08:01:49 (604) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/10 08:01:49 (604) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/10 08:06:50 (629) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/10 08:06:50 (629) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/10 08:06:50 (629) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/10 08:10:50 (662) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 08:11:51 (670) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/10 08:11:51 (670) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/10 08:11:51 (670) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/10 08:16:52 (701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/10 08:16:52 (701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/10 08:16:52 (701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/10 08:20:57 (734) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 08:21:53 (741) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/10 08:21:53 (741) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/10 08:21:53 (741) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/10 08:26:54 (824) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/10 08:26:54 (824) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/10 08:26:54 (824) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/10 08:30:23 (873) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 08:31:55 (885) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/10 08:31:55 (885) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/10 08:31:55 (885) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/10 08:36:56 (904) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/10 08:36:56 (904) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/10 08:36:56 (904) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/10 08:41:09 (937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 08:41:57 (944) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/10 08:41:57 (944) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/10 08:41:57 (944) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/10 08:46:58 (974) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/10 08:46:58 (974) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/10 08:46:58 (974) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/10 08:51:12 (1007) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 08:51:59 (1017) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/10 08:51:59 (1017) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/10 08:51:59 (1017) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/10 08:57:00 (1085) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/10 08:57:00 (1085) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/10 08:57:00 (1085) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/10 09:02:01 (1215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/10 09:02:01 (1215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/10 09:02:01 (1215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/10 09:02:07 (1216) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 09:07:02 (1246) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/10 09:07:02 (1246) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/10 09:07:02 (1246) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/10 09:12:03 (1265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/10 09:12:03 (1265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/10 09:12:03 (1265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/10 09:12:41 (1289) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 09:17:04 (1322) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/10 09:17:04 (1322) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/10 09:17:04 (1322) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/10 09:22:05 (1343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/10 09:22:05 (1343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/10 09:22:05 (1343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/10 09:22:39 (1372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 09:27:06 (1426) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/10 09:27:06 (1426) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/10 09:27:06 (1426) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/10 09:32:07 (1491) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/10 09:32:07 (1491) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/10 09:32:07 (1491) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/10 09:32:55 (1517) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 09:37:08 (1542) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/10 09:37:08 (1542) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/10 09:37:08 (1542) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/10 09:42:09 (1557) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/10 09:42:09 (1557) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/10 09:42:09 (1557) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/10 09:42:27 (1579) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 09:47:11 (1612) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/10 09:47:11 (1612) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/10 09:47:11 (1612) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/10 09:51:57 (1650) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 09:52:11 (1659) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/10 09:52:11 (1659) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/10 09:52:11 (1659) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/10 09:57:12 (1674) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/10 09:57:12 (1674) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/10 09:57:12 (1674) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/10 10:02:07 (1857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 10:02:13 (1863) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/10 10:02:13 (1863) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/10 10:02:13 (1863) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/10 10:07:14 (1881) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/10 10:07:14 (1881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/10 10:07:14 (1881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/10 10:12:15 (1912) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/10 10:12:15 (1912) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/10 10:12:15 (1912) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/10 10:13:07 (1937) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 10:17:16 (1965) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/10 10:17:16 (1965) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/10 10:17:16 (1965) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/10 10:22:17 (1994) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/10 10:22:17 (1994) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/10 10:22:17 (1994) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/10 10:23:35 (2018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 10:27:18 (2035) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/10 10:27:18 (2035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/10 10:27:18 (2035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/10 10:32:19 (2142) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/10 10:32:19 (2142) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/10 10:32:19 (2142) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/10 10:33:44 (2169) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 10:37:20 (2182) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/10 10:37:20 (2182) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/10 10:37:20 (2182) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/10 10:42:21 (2206) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/10 10:42:21 (2206) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/10 10:42:21 (2206) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/10 10:44:06 (2239) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 10:47:22 (2263) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/10 10:47:22 (2263) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/10 10:47:22 (2263) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/10 10:52:23 (2285) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/10 10:52:23 (2285) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/10 10:52:23 (2285) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/10 10:53:29 (2311) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 10:57:24 (2329) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/10 10:57:24 (2329) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/10 10:57:24 (2329) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/10 11:02:25 (2466) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/10 11:02:25 (2466) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/10 11:02:25 (2466) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/10 11:02:49 (2488) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 11:07:26 (2532) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/10 11:07:26 (2532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/10 11:07:26 (2532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/10 11:12:27 (2570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/10 11:12:27 (2570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/10 11:12:27 (2570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/10 11:12:31 (2572) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 11:17:28 (2602) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/10 11:17:28 (2602) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/10 11:17:28 (2602) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/10 11:22:29 (2648) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/10 11:22:29 (2648) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/10 11:22:29 (2648) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/10 11:22:32 (2649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 11:27:30 (2666) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/10 11:27:30 (2666) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/10 11:27:30 (2666) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/10 11:31:58 (2736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 11:32:31 (2763) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/10 11:32:31 (2763) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/10 11:32:31 (2763) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/10 11:37:32 (2801) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/10 11:37:32 (2801) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/10 11:37:32 (2801) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/10 11:42:33 (2820) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/10 11:42:33 (2820) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/10 11:42:33 (2820) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/10 11:42:58 (2841) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 11:47:34 (2865) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/10 11:47:35 (2865) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/10 11:47:35 (2865) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/10 11:52:35 (2891) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/10 11:52:35 (2891) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/10 11:52:35 (2891) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/10 11:53:18 (2912) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 11:57:36 (2925) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/10 11:57:36 (2925) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/10 11:57:36 (2925) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/10 12:02:37 (3038) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/10 12:02:37 (3038) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/10 12:02:37 (3038) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/10 12:02:55 (3059) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 12:07:38 (3124) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/10 12:07:38 (3124) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/10 12:07:38 (3124) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/10 12:12:39 (3145) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/10 12:12:39 (3145) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/10 12:12:39 (3145) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/10 12:13:06 (3169) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 12:17:40 (3199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/10 12:17:40 (3199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/10 12:17:40 (3199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/10 12:22:14 (3240) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 12:22:41 (3252) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/10 12:22:41 (3252) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/10 12:22:41 (3252) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/10 12:27:42 (3261) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/10 12:27:42 (3261) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/10 12:27:42 (3261) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/10 12:31:47 (3292) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 12:32:43 (3304) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/10 12:32:43 (3304) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/10 12:32:43 (3304) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/10 12:37:44 (3394) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/10 12:37:44 (3394) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/10 12:37:44 (3394) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/10 12:42:18 (3434) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 12:42:45 (3441) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/10 12:42:45 (3441) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/10 12:42:45 (3441) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/10 12:47:46 (3463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/10 12:47:46 (3463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/10 12:47:46 (3463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/10 12:51:24 (3502) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 12:52:47 (3515) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/10 12:52:47 (3515) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/10 12:52:47 (3515) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/10 12:57:48 (3524) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/10 12:57:48 (3524) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/10 12:57:48 (3524) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/10 13:01:57 (3620) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 13:02:49 (3634) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/10 13:02:49 (3634) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/10 13:02:49 (3634) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/10 13:07:50 (3720) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/10 13:07:50 (3720) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/10 13:07:50 (3720) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/10 13:11:26 (3761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 13:12:51 (3772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/10 13:12:51 (3772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/10 13:12:51 (3772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/10 13:17:52 (3794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/10 13:17:52 (3794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/10 13:17:52 (3794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/10 13:21:17 (3838) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 13:22:53 (3848) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/10 13:22:53 (3848) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/10 13:22:53 (3848) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/10 13:27:54 (3856) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/10 13:27:54 (3856) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/10 13:27:54 (3856) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/10 13:32:06 (3894) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 13:32:55 (3901) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/10 13:32:55 (3901) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/10 13:32:55 (3901) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/10 13:37:56 (3972) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/10 13:37:56 (3972) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/10 13:37:56 (3972) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/10 13:42:53 (4029) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 13:42:57 (4035) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/10 13:42:57 (4035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/10 13:42:57 (4035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/10 13:47:58 (4058) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/10 13:47:58 (4058) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/10 13:47:58 (4058) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/10 13:52:33 (4099) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 13:52:59 (4106) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/10 13:52:59 (4106) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/10 13:52:59 (4106) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/10 13:58:00 (4118) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/10 13:58:00 (4118) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/10 13:58:00 (4118) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/10 14:02:59 (4219) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 14:03:01 (4225) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/10 14:03:01 (4225) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/10 14:03:01 (4225) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/10 14:08:02 (4277) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/10 14:08:02 (4277) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/10 14:08:02 (4277) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/10 14:11:55 (4348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 14:13:03 (4358) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/10 14:13:03 (4358) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/10 14:13:03 (4358) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/10 14:18:04 (4392) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/10 14:18:04 (4392) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/10 14:18:04 (4392) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/10 14:22:56 (4434) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 14:23:05 (4440) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/10 14:23:05 (4440) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/10 14:23:05 (4440) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/10 14:28:06 (4451) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/10 14:28:06 (4451) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/10 14:28:06 (4451) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/10 14:32:17 (4483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 14:33:07 (4495) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/10 14:33:07 (4495) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/10 14:33:07 (4495) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/10 14:38:08 (4529) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/10 14:38:08 (4529) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/10 14:38:08 (4529) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/10 14:41:41 (4619) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 14:43:09 (4636) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/10 14:43:09 (4636) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/10 14:43:09 (4636) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/10 14:48:10 (4655) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/10 14:48:10 (4655) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/10 14:48:10 (4655) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/10 14:51:18 (4696) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 14:53:11 (4707) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/10 14:53:11 (4707) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/10 14:53:11 (4707) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/10 14:58:12 (4716) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/10 14:58:12 (4716) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/10 14:58:12 (4716) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/10 15:01:55 (4809) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 15:03:13 (4825) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/10 15:03:13 (4825) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/10 15:03:13 (4825) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/10 15:08:14 (4841) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/10 15:08:14 (4841) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/10 15:08:14 (4841) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/10 15:11:18 (4924) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 15:13:15 (4963) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/10 15:13:15 (4963) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/10 15:13:15 (4963) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/10 15:18:16 (4980) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/10 15:18:16 (4980) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/10 15:18:16 (4980) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/10 15:21:21 (5054) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 15:23:17 (5065) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/10 15:23:17 (5065) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/10 15:23:17 (5065) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/10 15:28:19 (5074) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/10 15:28:19 (5074) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/10 15:28:19 (5074) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/10 15:31:27 (5107) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 15:33:19 (5122) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/10 15:33:19 (5122) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/10 15:33:19 (5122) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/10 15:38:20 (5135) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/10 15:38:20 (5135) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/10 15:38:20 (5135) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/10 15:42:08 (5247) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 15:43:21 (5260) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/10 15:43:21 (5260) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/10 15:43:21 (5260) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/10 15:48:22 (5291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/10 15:48:22 (5291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/10 15:48:22 (5291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/10 15:51:16 (5340) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 15:53:23 (5351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/10 15:53:23 (5351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/10 15:53:23 (5351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/10 15:58:24 (5423) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/10 15:58:24 (5423) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/10 15:58:24 (5423) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/10 16:01:02 (5518) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 16:03:25 (5528) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/10 16:03:25 (5528) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/10 16:03:25 (5528) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/10 16:08:26 (5542) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/10 16:08:26 (5542) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/10 16:08:26 (5542) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/10 16:10:09 (5570) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 16:13:27 (5649) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/10 16:13:27 (5649) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/10 16:13:27 (5649) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/10 16:18:28 (5688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/10 16:18:28 (5688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/10 16:18:28 (5688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/10 16:19:59 (5728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 16:23:29 (5749) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/10 16:23:29 (5749) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/10 16:23:29 (5749) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/10 16:28:30 (5758) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/10 16:28:30 (5758) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/10 16:28:30 (5758) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/10 16:30:52 (5786) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 16:33:31 (5804) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/10 16:33:31 (5804) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/10 16:33:31 (5804) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/10 16:38:32 (5816) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/10 16:38:32 (5816) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/10 16:38:32 (5816) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/10 16:41:37 (5848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 16:43:33 (5900) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/10 16:43:33 (5900) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/10 16:43:33 (5900) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/10 16:48:34 (5950) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/10 16:48:34 (5950) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/10 16:48:34 (5950) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/10 16:50:55 (6000) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 16:53:35 (6013) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/10 16:53:35 (6013) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/10 16:53:35 (6013) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/10 16:58:36 (6019) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/10 16:58:36 (6019) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/10 16:58:36 (6019) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/10 17:01:03 (6112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 17:03:37 (6131) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/10 17:03:37 (6131) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/10 17:03:37 (6131) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/10 17:08:38 (6143) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/10 17:08:38 (6143) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/10 17:08:38 (6143) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/10 17:10:40 (6170) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 17:13:40 (6194) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/10 17:13:40 (6194) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/10 17:13:40 (6194) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/10 17:18:40 (6281) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/10 17:18:40 (6281) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/10 17:18:40 (6281) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/10 17:19:48 (6320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 17:23:41 (6393) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/10 17:23:41 (6393) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/10 17:23:41 (6393) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/10 17:28:42 (6399) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/10 17:28:42 (6399) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/10 17:28:42 (6399) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/10 17:30:25 (6429) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 17:33:43 (6445) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/10 17:33:43 (6445) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/10 17:33:43 (6445) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/10 17:38:44 (6459) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/10 17:38:44 (6459) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/10 17:38:44 (6459) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/10 17:41:12 (6490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 17:43:45 (6507) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/10 17:43:45 (6507) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/10 17:43:45 (6507) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/10 17:48:46 (6593) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/10 17:48:46 (6593) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/10 17:48:46 (6593) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/10 17:50:15 (6637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 17:53:47 (6653) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/10 17:53:47 (6653) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/10 17:53:47 (6653) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/10 17:58:48 (6665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/10 17:58:48 (6665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/10 17:58:48 (6665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/10 17:59:56 (6691) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:03:49 (6776) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/10 18:03:49 (6776) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/10 18:03:49 (6776) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/10 18:08:50 (6788) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/10 18:08:50 (6788) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/10 18:08:50 (6788) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/10 18:10:03 (6818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:13:51 (6839) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/10 18:13:51 (6839) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/10 18:13:51 (6839) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/10 18:18:52 (6908) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:18:52 (6908) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 18:18:52 (6908) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 18:18:52 (6908) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 18:20:56 (6977) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:23:53 (6994) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/10 18:23:53 (6994) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/10 18:23:53 (6994) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/10 18:28:54 (7002) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:28:54 (7002) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 18:28:54 (7002) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 18:28:54 (7002) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 18:31:51 (7035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:33:55 (7046) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/10 18:33:55 (7046) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/10 18:33:55 (7046) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/10 18:38:56 (7059) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:38:56 (7059) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 18:38:56 (7059) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 18:38:57 (7059) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 18:41:43 (7097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:43:57 (7108) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/10 18:43:57 (7108) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/10 18:43:57 (7108) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/10 18:48:58 (7170) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/10 18:48:58 (7170) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/10 18:48:58 (7170) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/10 18:51:17 (7238) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 18:53:59 (7253) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/10 18:53:59 (7253) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/10 18:53:59 (7253) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/10 18:59:00 (7265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/10 18:59:00 (7265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/10 18:59:00 (7265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/10 19:02:11 (7365) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:04:02 (7373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/10 19:04:02 (7373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/10 19:04:02 (7373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/10 19:09:02 (7388) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:09:02 (7388) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 19:09:02 (7388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 19:09:02 (7388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 19:11:16 (7429) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:14:03 (7438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/10 19:14:03 (7438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/10 19:14:03 (7438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/10 19:19:04 (7485) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:19:04 (7485) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 19:19:04 (7485) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 19:19:04 (7485) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 19:21:24 (7562) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:24:05 (7590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/10 19:24:05 (7590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/10 19:24:05 (7590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/10 19:29:06 (7596) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:29:06 (7596) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 19:29:06 (7596) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 19:29:06 (7596) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 19:31:27 (7634) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:34:07 (7645) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/10 19:34:07 (7645) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/10 19:34:07 (7645) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/10 19:39:08 (7652) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:39:08 (7652) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 19:39:08 (7652) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 19:39:08 (7652) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 19:40:50 (7686) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:44:09 (7707) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/10 19:44:09 (7707) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/10 19:44:09 (7707) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/10 19:49:10 (7716) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/10 19:49:10 (7716) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/10 19:49:10 (7716) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/10 19:51:09 (7818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 19:54:11 (7860) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/10 19:54:11 (7860) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/10 19:54:11 (7860) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/10 19:59:12 (7870) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/10 19:59:12 (7870) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/10 19:59:12 (7870) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/10 20:00:46 (7941) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 20:04:13 (7972) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/10 20:04:13 (7972) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/10 20:04:13 (7972) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/10 20:09:14 (7986) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/10 20:09:14 (7986) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/10 20:09:14 (7986) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/10 20:11:37 (8013) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 20:14:15 (8028) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/10 20:14:15 (8028) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/10 20:14:15 (8028) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/10 20:19:16 (8047) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/10 20:19:16 (8047) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/10 20:19:16 (8047) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/10 20:22:02 (8135) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 20:24:17 (8185) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/10 20:24:17 (8185) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/10 20:24:17 (8185) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/10 20:29:18 (8199) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 20:29:18 (8199) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 20:29:18 (8199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 20:29:18 (8199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 20:31:26 (8231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 20:34:19 (8241) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/10 20:34:19 (8241) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/10 20:34:19 (8241) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/10 20:39:20 (8257) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 20:39:21 (8257) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 20:39:21 (8257) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 20:39:21 (8257) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 20:42:21 (8289) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 20:44:21 (8301) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/10 20:44:21 (8301) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/10 20:44:21 (8301) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/10 20:49:22 (8314) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/10 20:49:22 (8314) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/10 20:49:22 (8314) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/10 20:52:56 (8400) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 20:54:24 (8426) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/10 20:54:24 (8426) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/10 20:54:24 (8426) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/10 20:59:25 (8465) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/10 20:59:25 (8465) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/10 20:59:25 (8465) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/10 21:03:25 (8560) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:04:26 (8571) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/10 21:04:26 (8571) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/10 21:04:26 (8571) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/10 21:09:27 (8584) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/10 21:09:27 (8584) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/10 21:09:27 (8584) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/10 21:13:03 (8614) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:14:28 (8621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:14:28 (8621) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 21:14:28 (8621) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 21:14:28 (8621) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 21:19:29 (8646) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/10 21:19:29 (8646) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/10 21:19:29 (8646) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/10 21:23:02 (8700) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:24:30 (8744) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:24:30 (8744) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 21:24:30 (8744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 21:24:30 (8744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 21:29:31 (8800) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/10 21:29:31 (8800) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/10 21:29:31 (8800) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/10 21:33:29 (8830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:34:32 (8837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:34:32 (8837) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 21:34:32 (8837) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 21:34:32 (8837) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 21:39:33 (8857) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/10 21:39:33 (8857) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/10 21:39:33 (8857) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/10 21:44:19 (8887) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:44:34 (8893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/10 21:44:34 (8893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/10 21:44:34 (8893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/10 21:49:35 (8912) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/10 21:49:35 (8912) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/10 21:49:35 (8912) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/10 21:54:36 (8962) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:54:36 (8962) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 21:54:36 (8962) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 21:54:36 (8962) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 21:55:09 (9007) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 21:59:37 (9068) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/10 21:59:37 (9068) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/10 21:59:37 (9068) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/10 22:04:38 (9145) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:04:38 (9145) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 22:04:38 (9145) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 22:04:38 (9145) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 22:06:08 (9173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:09:39 (9186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/10 22:09:39 (9186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/10 22:09:39 (9186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/10 22:14:40 (9196) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:14:40 (9196) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 22:14:40 (9196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 22:14:40 (9196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 22:16:23 (9221) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:19:41 (9249) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/10 22:19:41 (9249) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/10 22:19:41 (9249) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/10 22:24:42 (9285) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/10 22:24:42 (9285) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/10 22:24:42 (9285) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/10 22:25:44 (9321) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:29:43 (9401) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/10 22:29:43 (9401) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/10 22:29:43 (9401) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/10 22:34:44 (9411) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:34:45 (9411) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 22:34:45 (9411) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 22:34:45 (9411) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 22:36:06 (9441) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:39:45 (9458) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/10 22:39:45 (9458) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/10 22:39:45 (9458) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/10 22:44:46 (9468) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:44:47 (9468) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 22:44:47 (9468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 22:44:47 (9468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 22:46:55 (9497) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:49:48 (9517) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/10 22:49:48 (9517) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/10 22:49:48 (9517) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/10 22:54:48 (9551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:54:48 (9551) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 22:54:48 (9551) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 22:54:48 (9551) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 22:57:35 (9620) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 22:59:49 (9656) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/10 22:59:49 (9656) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/10 22:59:49 (9656) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/10 23:04:50 (9750) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 23:04:50 (9750) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 23:04:50 (9750) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 23:04:50 (9750) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 23:07:31 (9783) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 23:09:51 (9794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/10 23:09:51 (9794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/10 23:09:51 (9794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/10 23:14:52 (9804) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 23:14:52 (9804) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/10 23:14:52 (9804) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/10 23:14:52 (9804) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/10 23:16:47 (9838) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 23:19:53 (9878) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/10 23:19:53 (9878) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/10 23:19:53 (9878) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/10 23:24:54 (9910) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/10 23:24:54 (9910) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/10 23:24:54 (9910) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/10 23:26:35 (9938) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 23:29:55 (10009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/10 23:29:55 (10009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/10 23:29:55 (10009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/10 23:34:56 (10046) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/10 23:34:56 (10046) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/10 23:34:56 (10046) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/10 23:36:00 (10070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 23:39:57 (10085) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/10 23:39:57 (10085) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/10 23:39:57 (10085) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/10 23:44:58 (10123) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/10 23:44:58 (10123) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/10 23:44:58 (10123) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/10 23:46:12 (10152) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/10 23:49:59 (10167) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/10 23:49:59 (10167) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/10 23:49:59 (10167) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/10 23:55:00 (10210) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/10 23:55:00 (10210) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/10 23:55:00 (10210) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/10 23:56:57 (10236) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 00:00:02 (10346) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/11 00:00:02 (10346) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/11 00:00:02 (10346) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/11 00:00:04 (10352) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/11 00:00:04 (10352) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/11 00:00:04 (10352) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/11 00:00:04 (10354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/11 00:00:04 (10354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/11 00:00:04 (10354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/11 00:00:05 (10394) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/11 00:00:05 (10394) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/11 00:00:05 (10394) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/11 00:00:06 (10397) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/11 00:00:06 (10397) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/11 00:00:06 (10397) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/11 00:05:07 (10469) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/11 00:05:07 (10469) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/11 00:05:07 (10469) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/11 00:06:46 (10492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 00:10:08 (10511) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/11 00:10:08 (10511) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/11 00:10:08 (10511) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/11 00:15:09 (10519) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/11 00:15:09 (10519) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/11 00:15:09 (10519) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/11 00:15:58 (10541) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 00:20:10 (10568) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/11 00:20:10 (10568) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/11 00:20:10 (10568) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/11 00:25:08 (10622) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 00:25:11 (10629) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/11 00:25:11 (10629) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/11 00:25:11 (10629) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/11 00:30:12 (10648) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/11 00:30:12 (10648) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/11 00:30:12 (10648) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/11 00:35:13 (10739) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/11 00:35:13 (10739) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/11 00:35:13 (10739) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/11 00:35:50 (10760) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 00:40:14 (10781) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/11 00:40:14 (10781) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/11 00:40:14 (10781) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/11 00:45:15 (10794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/11 00:45:15 (10794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/11 00:45:15 (10794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/11 00:46:38 (10816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 00:50:17 (10838) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/11 00:50:17 (10838) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/11 00:50:17 (10838) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/11 00:55:17 (10872) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/11 00:55:17 (10872) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/11 00:55:17 (10872) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/11 00:56:46 (10894) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 01:00:18 (10957) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/11 01:00:18 (10957) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/11 01:00:18 (10957) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/11 01:05:24 (11128) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/11 01:05:24 (11128) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/11 01:05:24 (11128) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/11 01:06:31 (11215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 01:10:25 (11240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/11 01:10:25 (11240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/11 01:10:25 (11240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/11 01:15:26 (11250) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/11 01:15:26 (11250) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/11 01:15:26 (11250) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/11 01:16:40 (11280) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 01:20:27 (11297) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/11 01:20:27 (11297) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/11 01:20:27 (11297) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/11 01:25:28 (11342) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/11 01:25:28 (11342) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/11 01:25:28 (11342) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/11 01:25:42 (11346) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 01:30:29 (11365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/11 01:30:29 (11365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/11 01:30:29 (11365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/11 01:35:25 (11462) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 01:35:30 (11468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/11 01:35:30 (11468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/11 01:35:30 (11468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/11 01:40:32 (11506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/11 01:40:32 (11506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/11 01:40:32 (11506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/11 01:44:48 (11534) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 01:45:33 (11544) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/11 01:45:33 (11544) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/11 01:45:33 (11544) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/11 01:50:34 (11556) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/11 01:50:34 (11556) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/11 01:50:34 (11556) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/11 01:53:51 (11599) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 01:55:35 (11613) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/11 01:55:35 (11613) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/11 01:55:35 (11613) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/11 02:00:36 (11677) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/11 02:00:36 (11677) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/11 02:00:36 (11677) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/11 02:03:25 (11725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 02:05:37 (11794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/11 02:05:37 (11794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/11 02:05:37 (11794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/11 02:10:38 (11847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/11 02:10:38 (11847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/11 02:10:38 (11847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/11 02:12:59 (11874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 02:15:39 (11888) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/11 02:15:39 (11888) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/11 02:15:39 (11888) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/11 02:20:40 (11903) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/11 02:20:40 (11903) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/11 02:20:40 (11903) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/11 02:23:22 (11944) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 02:25:41 (11959) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/11 02:25:41 (11959) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/11 02:25:41 (11959) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/11 02:30:42 (12032) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/11 02:30:42 (12032) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/11 02:30:42 (12032) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/11 02:32:45 (12055) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 02:35:43 (12114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/11 02:35:43 (12114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/11 02:35:43 (12114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/11 02:40:44 (12174) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/11 02:40:44 (12174) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/11 02:40:44 (12174) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/11 02:43:26 (12202) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 02:45:45 (12215) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/11 02:45:45 (12215) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/11 02:45:45 (12215) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/11 02:50:46 (12228) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/11 02:50:46 (12228) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/11 02:50:46 (12228) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/11 02:53:22 (12269) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 02:55:47 (12285) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/11 02:55:47 (12285) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/11 02:55:47 (12285) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/11 03:00:48 (12342) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/11 03:00:48 (12342) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/11 03:00:48 (12342) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/11 03:03:53 (12390) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 03:05:49 (12411) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/11 03:05:49 (12411) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/11 03:05:49 (12411) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/11 03:10:50 (12527) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/11 03:10:50 (12527) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/11 03:10:50 (12527) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/11 03:13:42 (12551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 03:15:51 (12565) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/11 03:15:51 (12565) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/11 03:15:51 (12565) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/11 03:20:52 (12580) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/11 03:20:52 (12580) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/11 03:20:52 (12580) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/11 03:22:51 (12612) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 03:25:54 (12638) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/11 03:25:54 (12638) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/11 03:25:54 (12638) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/11 03:30:54 (12907) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/11 03:30:54 (12907) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/11 03:30:54 (12907) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/11 03:32:55 (12930) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 03:35:55 (12954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/11 03:35:55 (12954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/11 03:35:55 (12954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/11 03:40:56 (13052) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/11 03:40:56 (13052) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/11 03:40:56 (13052) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/11 03:43:21 (13077) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 03:45:57 (13094) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/11 03:45:57 (13094) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/11 03:45:57 (13094) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/11 03:50:58 (13105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/11 03:50:58 (13105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/11 03:50:58 (13105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/11 03:52:38 (13137) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 03:55:59 (13165) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/11 03:55:59 (13165) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/11 03:55:59 (13165) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/11 04:01:00 (13224) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/11 04:01:00 (13224) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/11 04:01:00 (13224) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/11 04:03:06 (13264) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 04:06:01 (13284) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/11 04:06:01 (13284) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/11 04:06:01 (13284) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/11 04:11:02 (13365) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/11 04:11:02 (13365) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/11 04:11:02 (13365) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/11 04:13:26 (13409) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 04:16:03 (13423) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/11 04:16:03 (13423) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/11 04:16:03 (13423) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/11 04:21:04 (13438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/11 04:21:04 (13438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/11 04:21:04 (13438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/11 04:22:51 (13470) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 04:26:05 (13491) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/11 04:26:05 (13491) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/11 04:26:05 (13491) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/11 04:31:06 (13506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/11 04:31:06 (13506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/11 04:31:06 (13506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/11 04:32:59 (13529) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 04:36:07 (13548) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/11 04:36:07 (13548) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/11 04:36:07 (13548) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/11 04:41:08 (13629) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/11 04:41:08 (13629) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/11 04:41:08 (13629) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/11 04:42:09 (13655) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 04:46:09 (13683) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/11 04:46:09 (13683) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/11 04:46:09 (13683) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/11 04:51:10 (13701) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/11 04:51:10 (13701) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/11 04:51:10 (13701) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/11 04:52:25 (13724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 04:56:11 (13754) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/11 04:56:11 (13754) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/11 04:56:11 (13754) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/11 05:01:12 (13831) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/11 05:01:12 (13831) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/11 05:01:12 (13831) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/11 05:02:58 (13862) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 05:06:13 (13874) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/11 05:06:13 (13874) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/11 05:06:13 (13874) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/11 05:11:14 (13919) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/11 05:11:14 (13919) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/11 05:11:14 (13919) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/11 05:12:37 (13979) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 05:16:16 (14015) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/11 05:16:16 (14015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/11 05:16:16 (14015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/11 05:21:16 (14031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/11 05:21:16 (14031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/11 05:21:16 (14031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/11 05:23:31 (14064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 05:26:17 (14084) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/11 05:26:17 (14084) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/11 05:26:17 (14084) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/11 05:31:18 (14101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/11 05:31:18 (14101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/11 05:31:18 (14101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/11 05:32:40 (14128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 05:36:19 (14146) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/11 05:36:19 (14146) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/11 05:36:19 (14146) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/11 05:41:20 (14165) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/11 05:41:20 (14165) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/11 05:41:20 (14165) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/11 05:43:23 (14227) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 05:46:21 (14278) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/11 05:46:21 (14278) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/11 05:46:21 (14278) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/11 05:51:22 (14291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/11 05:51:22 (14291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/11 05:51:22 (14291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/11 05:54:23 (14334) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 05:56:23 (14344) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/11 05:56:23 (14344) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/11 05:56:23 (14344) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/11 06:01:24 (14426) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/11 06:01:24 (14426) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/11 06:01:24 (14426) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/11 06:04:14 (14456) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 06:06:25 (14468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/11 06:06:25 (14468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/11 06:06:25 (14468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/11 06:11:26 (14486) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/11 06:11:26 (14486) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/11 06:11:26 (14486) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/11 06:15:11 (14580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 06:16:27 (14609) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/11 06:16:27 (14609) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/11 06:16:27 (14609) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/11 06:21:28 (14628) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/11 06:21:28 (14628) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/11 06:21:28 (14628) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/11 06:24:33 (14672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 06:26:29 (14681) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/11 06:26:29 (14681) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/11 06:26:29 (14681) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/11 06:31:30 (14698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/11 06:31:30 (14698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/11 06:31:30 (14698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/11 06:33:43 (14727) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 06:36:31 (14739) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/11 06:36:31 (14739) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/11 06:36:31 (14739) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/11 06:41:32 (14758) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/11 06:41:32 (14758) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/11 06:41:32 (14758) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/11 06:42:47 (14786) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 06:46:33 (14860) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/11 06:46:33 (14860) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/11 06:46:33 (14860) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/11 06:51:34 (14897) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/11 06:51:34 (14897) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/11 06:51:34 (14897) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/11 06:52:10 (14918) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 06:56:35 (14954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/11 06:56:35 (14954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/11 06:56:35 (14954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/11 07:01:36 (15031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/11 07:01:36 (15031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/11 07:01:36 (15031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/11 07:02:33 (15053) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 07:06:37 (15073) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/11 07:06:37 (15073) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/11 07:06:37 (15073) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/11 07:11:38 (15091) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/11 07:11:38 (15091) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/11 07:11:38 (15091) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/11 07:13:00 (15113) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 07:16:40 (15172) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/11 07:16:40 (15172) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/11 07:16:40 (15172) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/11 07:21:40 (15254) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/11 07:21:40 (15254) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/11 07:21:40 (15254) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/11 07:23:15 (15276) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 07:26:41 (15308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/11 07:26:41 (15308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/11 07:26:41 (15308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/11 07:31:42 (15324) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/11 07:31:42 (15324) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/11 07:31:42 (15324) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/11 07:32:19 (15345) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 07:36:43 (15363) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/11 07:36:43 (15363) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/11 07:36:43 (15363) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/11 07:41:44 (15410) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/11 07:41:44 (15410) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/11 07:41:44 (15410) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/11 07:41:50 (15411) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 07:46:45 (15452) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/11 07:46:45 (15452) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/11 07:46:45 (15452) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/11 07:50:56 (15568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 07:51:46 (15575) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/11 07:51:46 (15575) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/11 07:51:46 (15575) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/11 07:56:47 (15606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/11 07:56:47 (15606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/11 07:56:47 (15606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/11 08:01:44 (15764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 08:01:48 (15770) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/11 08:01:48 (15770) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/11 08:01:48 (15770) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/11 08:06:49 (15786) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/11 08:06:49 (15786) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/11 08:06:49 (15786) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/11 08:11:50 (15826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/11 08:11:50 (15826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/11 08:11:50 (15826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/11 08:12:00 (15827) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 08:16:51 (15844) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/11 08:16:51 (15844) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/11 08:16:51 (15844) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/11 08:21:52 (15961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/11 08:21:52 (15961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/11 08:21:52 (15961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/11 08:22:05 (15964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 08:26:53 (15997) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/11 08:26:53 (15997) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/11 08:26:53 (15997) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/11 08:31:54 (16009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/11 08:31:54 (16009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/11 08:31:54 (16009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/11 08:32:41 (16032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 08:36:55 (16052) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/11 08:36:55 (16052) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/11 08:36:55 (16052) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/11 08:41:56 (16075) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/11 08:41:56 (16075) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/11 08:41:56 (16075) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/11 08:43:26 (16097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 08:46:57 (16116) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/11 08:46:57 (16116) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/11 08:46:57 (16116) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/11 08:51:58 (16192) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/11 08:51:58 (16192) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/11 08:51:58 (16192) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/11 08:53:34 (16235) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 08:56:59 (16267) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/11 08:56:59 (16267) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/11 08:56:59 (16267) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/11 09:02:01 (16343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/11 09:02:01 (16343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/11 09:02:01 (16343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/11 09:04:23 (16372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 09:07:01 (16388) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/11 09:07:01 (16388) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/11 09:07:01 (16388) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/11 09:12:02 (16409) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/11 09:12:02 (16409) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/11 09:12:02 (16409) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/11 09:14:49 (16436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 09:17:03 (16447) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/11 09:17:03 (16447) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/11 09:17:03 (16447) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/11 09:22:04 (16525) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/11 09:22:04 (16525) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/11 09:22:04 (16525) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/11 09:25:11 (16583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 09:27:05 (16595) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/11 09:27:05 (16595) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/11 09:27:05 (16595) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/11 09:32:06 (16614) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/11 09:32:06 (16614) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/11 09:32:06 (16614) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/11 09:36:03 (16645) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 09:37:07 (16652) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/11 09:37:07 (16652) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/11 09:37:07 (16652) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/11 09:42:08 (16673) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/11 09:42:08 (16673) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/11 09:42:08 (16673) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/11 09:45:21 (16700) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 09:47:09 (16708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/11 09:47:09 (16708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/11 09:47:09 (16708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/11 09:52:10 (16766) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/11 09:52:10 (16766) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/11 09:52:10 (16766) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/11 09:54:56 (16844) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 09:57:11 (16862) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/11 09:57:11 (16862) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/11 09:57:11 (16862) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/11 10:02:12 (16937) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/11 10:02:12 (16937) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/11 10:02:12 (16937) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/11 10:04:09 (16972) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 10:07:13 (16984) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/11 10:07:13 (16984) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/11 10:07:13 (16984) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/11 10:12:14 (16996) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/11 10:12:14 (16996) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/11 10:12:14 (16996) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/11 10:13:46 (17036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 10:17:15 (17048) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/11 10:17:15 (17048) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/11 10:17:15 (17048) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/11 10:22:16 (17068) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/11 10:22:16 (17068) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/11 10:22:16 (17068) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/11 10:23:19 (17131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 10:27:17 (17196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/11 10:27:17 (17196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/11 10:27:17 (17196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/11 10:32:18 (17214) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/11 10:32:18 (17214) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/11 10:32:18 (17214) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/11 10:34:07 (17246) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 10:37:19 (17262) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/11 10:37:19 (17262) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/11 10:37:19 (17262) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/11 10:42:20 (17276) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/11 10:42:20 (17276) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/11 10:42:20 (17276) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/11 10:43:47 (17305) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 10:47:21 (17317) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/11 10:47:21 (17317) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/11 10:47:21 (17317) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/11 10:52:22 (17331) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/11 10:52:22 (17331) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/11 10:52:22 (17331) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/11 10:53:30 (17359) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 10:57:24 (17466) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/11 10:57:24 (17466) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/11 10:57:24 (17466) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/11 11:02:24 (17545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/11 11:02:24 (17545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/11 11:02:24 (17545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/11 11:04:25 (17578) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 11:07:25 (17590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/11 11:07:25 (17590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/11 11:07:25 (17590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/11 11:12:26 (17606) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/11 11:12:26 (17606) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/11 11:12:26 (17606) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/11 11:14:49 (17632) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 11:17:27 (17646) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/11 11:17:27 (17646) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/11 11:17:27 (17646) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/11 11:22:28 (17661) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/11 11:22:28 (17661) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/11 11:22:28 (17661) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/11 11:24:47 (17690) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 11:27:29 (17774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/11 11:27:29 (17774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/11 11:27:29 (17774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/11 11:32:30 (17807) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/11 11:32:30 (17807) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/11 11:32:30 (17807) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/11 11:34:41 (17835) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 11:37:31 (17853) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/11 11:37:31 (17853) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/11 11:37:31 (17853) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/11 11:42:32 (17867) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/11 11:42:32 (17867) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/11 11:42:32 (17867) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/11 11:45:15 (17893) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 11:47:33 (17908) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/11 11:47:33 (17908) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/11 11:47:33 (17908) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/11 11:52:34 (17918) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/11 11:52:34 (17918) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/11 11:52:34 (17918) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/11 11:55:07 (17947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 11:57:35 (18031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/11 11:57:35 (18031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/11 11:57:35 (18031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/11 12:02:36 (18131) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/11 12:02:36 (18131) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/11 12:02:36 (18131) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/11 12:05:19 (18165) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 12:07:37 (18182) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/11 12:07:37 (18182) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/11 12:07:37 (18182) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/11 12:12:38 (18195) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/11 12:12:38 (18195) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/11 12:12:38 (18195) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/11 12:14:29 (18224) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 12:17:39 (18239) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/11 12:17:39 (18239) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/11 12:17:39 (18239) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/11 12:22:40 (18251) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/11 12:22:40 (18251) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/11 12:22:40 (18251) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/11 12:24:25 (18277) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 12:27:41 (18326) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/11 12:27:41 (18326) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/11 12:27:41 (18326) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/11 12:32:42 (18401) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/11 12:32:42 (18401) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/11 12:32:42 (18401) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/11 12:34:24 (18424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 12:37:43 (18446) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/11 12:37:43 (18446) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/11 12:37:43 (18446) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/11 12:42:44 (18459) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/11 12:42:44 (18459) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/11 12:42:44 (18459) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/11 12:43:36 (18481) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 12:47:46 (18496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/11 12:47:46 (18496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/11 12:47:46 (18496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/11 12:52:46 (18512) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/11 12:52:46 (18512) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/11 12:52:46 (18512) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/11 12:53:49 (18534) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 12:57:47 (18570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/11 12:57:47 (18570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/11 12:57:47 (18570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/11 13:02:48 (18750) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/11 13:02:48 (18750) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/11 13:02:48 (18750) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/11 13:02:53 (18752) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 13:07:49 (18774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/11 13:07:49 (18774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/11 13:07:49 (18774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/11 13:12:38 (18806) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 13:12:50 (18812) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/11 13:12:50 (18812) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/11 13:12:50 (18812) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/11 13:17:51 (18830) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/11 13:17:51 (18830) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/11 13:17:51 (18830) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/11 13:21:58 (18862) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 13:22:52 (18869) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/11 13:22:52 (18869) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/11 13:22:52 (18869) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/11 13:27:53 (18899) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/11 13:27:53 (18899) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/11 13:27:53 (18899) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/11 13:31:02 (18987) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 13:32:54 (19027) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/11 13:32:54 (19027) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/11 13:32:54 (19027) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/11 13:37:55 (19045) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/11 13:37:55 (19045) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/11 13:37:55 (19045) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/11 13:41:31 (19076) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 13:42:56 (19084) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/11 13:42:56 (19084) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/11 13:42:56 (19084) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/11 13:47:57 (19096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/11 13:47:57 (19096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/11 13:47:57 (19096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/11 13:50:54 (19125) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 13:52:58 (19136) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/11 13:52:58 (19136) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/11 13:52:58 (19136) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/11 13:57:59 (19170) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/11 13:57:59 (19170) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/11 13:57:59 (19170) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/11 14:01:44 (19304) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 14:03:00 (19339) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/11 14:03:00 (19339) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/11 14:03:00 (19339) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/11 14:08:01 (19379) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/11 14:08:01 (19379) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/11 14:08:01 (19379) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/11 14:12:32 (19414) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 14:13:02 (19424) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/11 14:13:02 (19424) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/11 14:13:02 (19424) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/11 14:18:03 (19435) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/11 14:18:03 (19435) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/11 14:18:03 (19435) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/11 14:23:04 (19473) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/11 14:23:04 (19473) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/11 14:23:04 (19473) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/11 14:23:05 (19474) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 14:28:05 (19504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/11 14:28:05 (19504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/11 14:28:05 (19504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/11 14:32:31 (19563) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 14:33:06 (19594) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/11 14:33:06 (19594) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/11 14:33:06 (19594) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/11 14:38:07 (19648) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/11 14:38:07 (19648) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/11 14:38:07 (19648) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/11 14:42:07 (19682) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 14:43:09 (19692) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/11 14:43:09 (19692) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/11 14:43:09 (19692) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/11 14:48:09 (19698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/11 14:48:09 (19698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/11 14:48:09 (19698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/11 14:51:10 (19729) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 14:53:10 (19744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/11 14:53:10 (19744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/11 14:53:10 (19744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/11 14:58:11 (19772) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/11 14:58:11 (19772) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/11 14:58:11 (19772) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/11 15:01:43 (19870) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 15:03:12 (19902) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/11 15:03:12 (19902) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/11 15:03:12 (19902) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/11 15:08:13 (19981) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/11 15:08:13 (19981) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/11 15:08:13 (19981) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/11 15:11:57 (20015) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 15:13:14 (20026) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/11 15:13:14 (20026) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/11 15:13:14 (20026) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/11 15:18:15 (20039) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/11 15:18:15 (20039) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/11 15:18:15 (20039) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/11 15:22:50 (20097) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 15:23:16 (20104) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/11 15:23:16 (20104) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/11 15:23:16 (20104) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/11 15:28:17 (20130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/11 15:28:17 (20130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/11 15:28:17 (20130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/11 15:33:18 (20153) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/11 15:33:18 (20153) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/11 15:33:18 (20153) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/11 15:33:48 (20177) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 15:38:19 (20277) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/11 15:38:19 (20277) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/11 15:38:19 (20277) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/11 15:43:20 (20292) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/11 15:43:20 (20292) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/11 15:43:20 (20292) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/11 15:43:58 (20339) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 15:48:21 (20350) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/11 15:48:21 (20350) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/11 15:48:21 (20350) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/11 15:53:19 (20390) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 15:53:22 (20397) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/11 15:53:22 (20397) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/11 15:53:22 (20397) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/11 15:58:23 (20424) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/11 15:58:23 (20424) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/11 15:58:23 (20424) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/11 16:02:22 (20583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 16:03:24 (20590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/11 16:03:24 (20590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/11 16:03:24 (20590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/11 16:08:25 (20672) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/11 16:08:25 (20672) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/11 16:08:25 (20672) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/11 16:11:42 (20723) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 16:13:26 (20731) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/11 16:13:26 (20731) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/11 16:13:26 (20731) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/11 16:18:27 (20745) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/11 16:18:27 (20745) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/11 16:18:27 (20745) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/11 16:21:14 (20778) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 16:23:28 (20786) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/11 16:23:28 (20786) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/11 16:23:28 (20786) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/11 16:28:29 (20815) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/11 16:28:29 (20815) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/11 16:28:29 (20815) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/11 16:32:01 (20850) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 16:33:30 (20861) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/11 16:33:30 (20861) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/11 16:33:30 (20861) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/11 16:38:31 (20939) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/11 16:38:31 (20939) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/11 16:38:31 (20939) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/11 16:41:57 (20995) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 16:43:33 (21003) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/11 16:43:33 (21003) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/11 16:43:33 (21003) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/11 16:48:33 (21012) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/11 16:48:33 (21012) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/11 16:48:33 (21012) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/11 16:52:22 (21050) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 16:53:34 (21059) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/11 16:53:34 (21059) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/11 16:53:34 (21059) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/11 16:58:35 (21082) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/11 16:58:35 (21082) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/11 16:58:35 (21082) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/11 17:01:37 (21182) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 17:03:36 (21201) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/11 17:03:36 (21201) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/11 17:03:36 (21201) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/11 17:08:37 (21247) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/11 17:08:37 (21247) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/11 17:08:37 (21247) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/11 17:11:06 (21325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 17:13:38 (21336) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/11 17:13:38 (21336) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/11 17:13:38 (21336) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/11 17:18:39 (21344) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/11 17:18:39 (21344) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/11 17:18:39 (21344) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/11 17:20:42 (21374) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 17:23:40 (21393) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/11 17:23:40 (21393) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/11 17:23:40 (21393) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/11 17:28:41 (21415) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/11 17:28:41 (21415) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/11 17:28:41 (21415) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/11 17:31:00 (21449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 17:33:42 (21464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/11 17:33:42 (21464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/11 17:33:42 (21464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/11 17:38:43 (21487) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/11 17:38:43 (21487) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/11 17:38:43 (21487) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/11 17:41:35 (21579) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 17:43:44 (21608) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/11 17:43:44 (21608) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/11 17:43:44 (21608) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/11 17:48:45 (21614) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/11 17:48:45 (21614) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/11 17:48:45 (21614) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/11 17:52:21 (21649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 17:53:46 (21659) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/11 17:53:46 (21659) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/11 17:53:46 (21659) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/11 17:58:47 (21679) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/11 17:58:47 (21679) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/11 17:58:47 (21679) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/11 18:02:18 (21788) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 18:03:48 (21803) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/11 18:03:48 (21803) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/11 18:03:48 (21803) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/11 18:08:49 (21817) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/11 18:08:49 (21817) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/11 18:08:49 (21817) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/11 18:12:35 (21911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 18:13:50 (21939) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/11 18:13:50 (21939) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/11 18:13:50 (21939) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/11 18:18:51 (21948) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/11 18:18:51 (21948) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/11 18:18:51 (21948) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/11 18:22:59 (21991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 18:23:52 (21998) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/11 18:23:52 (21998) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/11 18:23:52 (21998) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/11 18:28:53 (22015) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/11 18:28:53 (22015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/11 18:28:53 (22015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/11 18:33:54 (22066) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/11 18:33:54 (22066) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/11 18:33:54 (22066) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/11 18:33:55 (22067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 18:38:56 (22089) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/11 18:38:56 (22089) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/11 18:38:56 (22089) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/11 18:43:36 (22183) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 18:43:56 (22193) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/11 18:43:56 (22193) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/11 18:43:56 (22193) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/11 18:48:57 (22221) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/11 18:48:57 (22221) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/11 18:48:57 (22221) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/11 18:53:48 (22258) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 18:53:58 (22264) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/11 18:53:58 (22264) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/11 18:53:58 (22264) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/11 18:58:59 (22281) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/11 18:58:59 (22281) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/11 18:58:59 (22281) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/11 19:04:00 (22382) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/11 19:04:00 (22382) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/11 19:04:00 (22382) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/11 19:04:44 (22405) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 19:09:01 (22422) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/11 19:09:01 (22422) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/11 19:09:01 (22422) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/11 19:14:02 (22496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/11 19:14:02 (22496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/11 19:14:02 (22496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/11 19:14:27 (22518) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 19:19:03 (22555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/11 19:19:03 (22555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/11 19:19:03 (22555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/11 19:24:04 (22574) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/11 19:24:04 (22574) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/11 19:24:04 (22574) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/11 19:24:46 (22596) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 19:29:05 (22617) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/11 19:29:05 (22617) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/11 19:29:05 (22617) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/11 19:34:06 (22649) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/11 19:34:06 (22649) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/11 19:34:06 (22649) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/11 19:35:07 (22674) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 19:39:07 (22692) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/11 19:39:07 (22692) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/11 19:39:07 (22692) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/11 19:44:08 (22731) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/11 19:44:08 (22731) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/11 19:44:08 (22731) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/11 19:45:19 (22789) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 19:49:09 (22821) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/11 19:49:09 (22821) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/11 19:49:09 (22821) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/11 19:54:10 (22834) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/11 19:54:10 (22834) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/11 19:54:10 (22834) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/11 19:55:52 (22860) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 19:59:11 (22887) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/11 19:59:11 (22887) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/11 19:59:11 (22887) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/11 20:04:12 (22979) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/11 20:04:12 (22979) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/11 20:04:12 (22979) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/11 20:05:14 (23005) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 20:09:13 (23025) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/11 20:09:13 (23025) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/11 20:09:13 (23025) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/11 20:14:14 (23038) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/11 20:14:14 (23038) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/11 20:14:14 (23038) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/11 20:15:26 (23080) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 20:19:15 (23157) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/11 20:19:15 (23157) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/11 20:19:15 (23157) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/11 20:24:16 (23172) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/11 20:24:16 (23172) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/11 20:24:16 (23172) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/11 20:25:45 (23197) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 20:29:17 (23221) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/11 20:29:17 (23221) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/11 20:29:17 (23221) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/11 20:34:18 (23250) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/11 20:34:18 (23250) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/11 20:34:18 (23250) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/11 20:35:32 (23277) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 20:39:20 (23297) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/11 20:39:20 (23297) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/11 20:39:20 (23297) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/11 20:44:21 (23307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/11 20:44:21 (23307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/11 20:44:21 (23307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/11 20:45:57 (23338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 20:49:22 (23428) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/11 20:49:22 (23428) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/11 20:49:22 (23428) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/11 20:54:23 (23439) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/11 20:54:23 (23439) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/11 20:54:23 (23439) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/11 20:55:19 (23465) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 20:59:24 (23492) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/11 20:59:24 (23492) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/11 20:59:24 (23492) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/11 21:04:25 (23604) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/11 21:04:25 (23604) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/11 21:04:25 (23604) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/11 21:04:26 (23605) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 21:09:26 (23628) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/11 21:09:26 (23628) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/11 21:09:26 (23628) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/11 21:13:59 (23657) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 21:14:27 (23664) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/11 21:14:27 (23664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/11 21:14:27 (23664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/11 21:19:28 (23740) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/11 21:19:28 (23740) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/11 21:19:28 (23740) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/11 21:23:10 (23792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 21:24:29 (23800) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/11 21:24:29 (23800) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/11 21:24:29 (23800) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/11 21:29:30 (23824) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/11 21:29:30 (23824) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/11 21:29:30 (23824) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/11 21:33:37 (23869) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 21:34:31 (23876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/11 21:34:31 (23876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/11 21:34:31 (23876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/11 21:39:32 (23899) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/11 21:39:32 (23899) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/11 21:39:32 (23899) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/11 21:42:53 (23927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 21:44:33 (23935) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/11 21:44:33 (23935) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/11 21:44:33 (23935) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/11 21:49:34 (23990) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/11 21:49:34 (23990) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/11 21:49:34 (23990) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/11 21:53:18 (24058) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 21:54:35 (24066) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/11 21:54:35 (24066) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/11 21:54:35 (24066) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/11 21:59:36 (24090) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/11 21:59:36 (24090) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/11 21:59:36 (24090) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/11 22:02:37 (24196) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 22:04:37 (24208) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/11 22:04:37 (24208) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/11 22:04:37 (24208) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/11 22:09:38 (24233) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/11 22:09:38 (24233) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/11 22:09:38 (24233) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/11 22:12:58 (24262) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 22:14:39 (24270) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/11 22:14:39 (24270) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/11 22:14:39 (24270) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/11 22:19:40 (24305) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/11 22:19:40 (24305) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/11 22:19:40 (24305) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/11 22:22:50 (24396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 22:24:41 (24406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/11 22:24:41 (24406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/11 22:24:41 (24406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/11 22:29:43 (24431) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/11 22:29:43 (24431) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/11 22:29:43 (24431) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/11 22:33:32 (24476) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 22:34:44 (24490) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/11 22:34:44 (24490) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/11 22:34:44 (24490) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/11 22:39:45 (24506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/11 22:39:45 (24506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/11 22:39:45 (24506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/11 22:43:25 (24535) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 22:44:46 (24545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/11 22:44:46 (24545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/11 22:44:46 (24545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/11 22:49:47 (24560) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/11 22:49:47 (24560) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/11 22:49:47 (24560) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/11 22:52:37 (24643) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 22:54:48 (24676) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/11 22:54:48 (24676) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/11 22:54:48 (24676) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/11 22:59:49 (24696) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/11 22:59:49 (24696) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/11 22:59:49 (24696) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/11 23:02:57 (24803) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 23:04:50 (24814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/11 23:04:50 (24814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/11 23:04:50 (24814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/11 23:09:51 (24836) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/11 23:09:51 (24836) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/11 23:09:51 (24836) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/11 23:13:20 (24866) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 23:14:52 (24876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/11 23:14:52 (24876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/11 23:14:52 (24876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/11 23:19:53 (24891) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/11 23:19:53 (24891) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/11 23:19:53 (24891) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/11 23:23:48 (25000) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 23:24:54 (25014) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/11 23:24:54 (25014) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/11 23:24:54 (25014) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/11 23:29:55 (25055) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/11 23:29:55 (25055) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/11 23:29:55 (25055) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/11 23:33:49 (25100) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 23:34:56 (25107) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/11 23:34:56 (25107) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/11 23:34:56 (25107) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/11 23:39:57 (25129) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/11 23:39:57 (25129) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/11 23:39:57 (25129) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/11 23:42:59 (25159) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 23:44:58 (25194) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/11 23:44:58 (25194) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/11 23:44:58 (25194) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/11 23:49:59 (25206) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/11 23:49:59 (25206) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/11 23:49:59 (25206) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/11 23:53:20 (25262) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/11 23:55:00 (25312) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/11 23:55:00 (25312) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/11 23:55:00 (25312) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/12 00:00:02 (25375) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/12 00:00:02 (25375) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/12 00:00:02 (25375) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/12 00:04:17 (25531) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 00:05:02 (25541) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/12 00:05:02 (25541) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/12 00:05:02 (25541) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/12 00:10:03 (25561) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/12 00:10:03 (25561) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/12 00:10:03 (25561) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/12 00:15:04 (25589) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/12 00:15:04 (25589) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/12 00:15:04 (25589) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/12 00:15:06 (25593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 00:20:05 (25617) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/12 00:20:05 (25617) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/12 00:20:05 (25617) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/12 00:25:06 (25664) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/12 00:25:06 (25664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/12 00:25:06 (25664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/12 00:25:41 (25700) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 00:30:07 (25754) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/12 00:30:07 (25754) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/12 00:30:07 (25754) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/12 00:35:08 (25781) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/12 00:35:08 (25781) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/12 00:35:08 (25781) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/12 00:35:36 (25803) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 00:40:09 (25823) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/12 00:40:09 (25823) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/12 00:40:09 (25823) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/12 00:45:10 (25857) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/12 00:45:10 (25857) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/12 00:45:10 (25857) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/12 00:45:28 (25859) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 00:50:11 (25879) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/12 00:50:11 (25879) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/12 00:50:11 (25879) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/12 00:55:12 (25910) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/12 00:55:12 (25910) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/12 00:55:12 (25910) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/12 00:55:14 (25911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 01:00:13 (26061) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/12 01:00:13 (26061) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/12 01:00:13 (26061) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/12 01:04:19 (26131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 01:05:25 (26199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/12 01:05:25 (26199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/12 01:05:25 (26199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/12 01:06:08 (26289) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 01:10:26 (26318) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/12 01:10:26 (26318) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/12 01:10:26 (26318) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/12 01:15:27 (26327) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/12 01:15:27 (26327) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/12 01:15:27 (26327) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/12 01:16:36 (26359) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 01:20:28 (26372) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/12 01:20:28 (26372) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/12 01:20:28 (26372) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/12 01:25:29 (26381) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/12 01:25:29 (26381) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/12 01:25:29 (26381) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/12 01:26:27 (26412) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 01:30:30 (26509) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/12 01:30:30 (26509) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/12 01:30:30 (26509) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/12 01:35:31 (26539) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/12 01:35:31 (26539) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/12 01:35:31 (26539) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/12 01:35:59 (26560) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 01:40:32 (26584) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/12 01:40:32 (26584) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/12 01:40:32 (26584) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/12 01:45:33 (26592) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/12 01:45:33 (26592) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/12 01:45:33 (26592) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/12 01:46:03 (26613) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 01:50:34 (26633) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/12 01:50:34 (26633) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/12 01:50:34 (26633) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/12 01:55:35 (26661) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/12 01:55:35 (26661) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/12 01:55:35 (26661) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/12 01:55:41 (26662) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 02:00:36 (26797) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/12 02:00:36 (26797) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/12 02:00:36 (26797) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/12 02:05:37 (26869) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/12 02:05:37 (26869) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/12 02:05:37 (26869) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/12 02:06:31 (26897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 02:10:38 (26920) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/12 02:10:38 (26920) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/12 02:10:38 (26920) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/12 02:15:39 (26931) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/12 02:15:39 (26931) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/12 02:15:39 (26931) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/12 02:16:00 (26952) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 02:20:40 (26971) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/12 02:20:40 (26971) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/12 02:20:40 (26971) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/12 02:25:04 (27002) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 02:25:41 (27009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/12 02:25:41 (27009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/12 02:25:41 (27009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/12 02:30:42 (27143) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/12 02:30:42 (27143) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/12 02:30:42 (27143) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/12 02:35:31 (27218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 02:35:43 (27225) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/12 02:35:43 (27225) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/12 02:35:43 (27225) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/12 02:40:44 (27240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/12 02:40:44 (27240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/12 02:40:44 (27240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/12 02:45:46 (27252) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/12 02:45:46 (27252) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/12 02:45:46 (27252) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/12 02:46:07 (27273) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 02:50:46 (27291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/12 02:50:46 (27291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/12 02:50:46 (27291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/12 02:55:13 (27322) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 02:55:47 (27329) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/12 02:55:47 (27329) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/12 02:55:47 (27329) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/12 03:00:48 (27429) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/12 03:00:48 (27429) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/12 03:00:48 (27429) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/12 03:04:25 (27528) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 03:05:49 (27545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/12 03:05:49 (27545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/12 03:05:49 (27545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/12 03:10:50 (27569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/12 03:10:50 (27569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/12 03:10:50 (27569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/12 03:14:20 (27614) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 03:15:51 (27625) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/12 03:15:51 (27625) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/12 03:15:51 (27625) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/12 03:20:52 (27640) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/12 03:20:52 (27640) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/12 03:20:52 (27640) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/12 03:23:51 (27667) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 03:25:53 (27678) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/12 03:25:53 (27678) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/12 03:25:53 (27678) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/12 03:30:54 (27700) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/12 03:30:54 (27700) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/12 03:30:54 (27700) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/12 03:34:37 (28091) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 03:35:55 (28101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/12 03:35:55 (28101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/12 03:35:55 (28101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/12 03:40:56 (28124) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/12 03:40:56 (28124) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/12 03:40:56 (28124) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/12 03:45:24 (28154) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 03:45:57 (28161) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/12 03:45:57 (28161) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/12 03:45:57 (28161) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/12 03:50:58 (28174) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/12 03:50:58 (28174) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/12 03:50:58 (28174) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/12 03:54:48 (28204) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 03:55:59 (28211) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/12 03:55:59 (28211) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/12 03:55:59 (28211) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/12 04:01:00 (28278) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/12 04:01:00 (28278) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/12 04:01:00 (28278) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/12 04:04:19 (28389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 04:06:01 (28426) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/12 04:06:01 (28426) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/12 04:06:01 (28426) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/12 04:11:02 (28449) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/12 04:11:02 (28449) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/12 04:11:02 (28449) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/12 04:15:16 (28480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 04:16:03 (28487) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/12 04:16:03 (28487) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/12 04:16:03 (28487) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/12 04:21:04 (28504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/12 04:21:04 (28504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/12 04:21:04 (28504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/12 04:24:18 (28533) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 04:26:05 (28541) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/12 04:26:05 (28541) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/12 04:26:05 (28541) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/12 04:31:06 (28560) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/12 04:31:06 (28560) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/12 04:31:06 (28560) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/12 04:34:04 (28626) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 04:36:08 (28677) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/12 04:36:08 (28677) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/12 04:36:08 (28677) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/12 04:41:08 (28714) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/12 04:41:08 (28714) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/12 04:41:08 (28714) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/12 04:44:50 (28742) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 04:46:09 (28753) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/12 04:46:09 (28753) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/12 04:46:09 (28753) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/12 04:51:10 (28767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/12 04:51:10 (28767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/12 04:51:10 (28767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/12 04:55:01 (28795) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 04:56:11 (28805) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/12 04:56:11 (28805) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/12 04:56:11 (28805) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/12 05:01:12 (28887) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/12 05:01:12 (28887) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/12 05:01:12 (28887) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/12 05:04:50 (28942) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 05:06:13 (28993) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/12 05:06:13 (28993) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/12 05:06:13 (28993) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/12 05:11:14 (29044) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/12 05:11:14 (29044) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/12 05:11:14 (29044) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/12 05:14:44 (29071) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 05:16:15 (29081) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/12 05:16:15 (29081) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/12 05:16:15 (29081) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/12 05:21:16 (29096) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/12 05:21:16 (29096) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/12 05:21:16 (29096) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/12 05:24:16 (29122) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 05:26:17 (29132) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/12 05:26:17 (29132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/12 05:26:17 (29132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/12 05:31:18 (29151) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/12 05:31:18 (29151) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/12 05:31:18 (29151) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/12 05:33:17 (29188) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 05:36:19 (29233) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/12 05:36:19 (29233) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/12 05:36:19 (29233) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/12 05:41:20 (29307) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/12 05:41:20 (29307) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/12 05:41:20 (29307) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/12 05:42:31 (29332) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 05:46:21 (29345) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/12 05:46:21 (29345) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/12 05:46:21 (29345) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/12 05:51:22 (29356) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/12 05:51:22 (29356) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/12 05:51:22 (29356) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/12 05:52:43 (29384) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 05:56:23 (29396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/12 05:56:23 (29396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/12 05:56:23 (29396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/12 06:01:24 (29477) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/12 06:01:24 (29477) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/12 06:01:24 (29477) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/12 06:02:40 (29503) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 06:06:25 (29542) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/12 06:06:25 (29542) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/12 06:06:25 (29542) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/12 06:11:26 (29634) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/12 06:11:26 (29634) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/12 06:11:26 (29634) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/12 06:12:00 (29656) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 06:16:27 (29674) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/12 06:16:27 (29674) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/12 06:16:27 (29674) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/12 06:21:28 (29708) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/12 06:21:28 (29708) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/12 06:21:28 (29708) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/12 06:21:44 (29709) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 06:26:29 (29727) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/12 06:26:29 (29727) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/12 06:26:29 (29727) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/12 06:31:30 (29744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/12 06:31:30 (29744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/12 06:31:30 (29744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/12 06:31:58 (29766) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 06:36:31 (29803) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/12 06:36:31 (29803) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/12 06:36:31 (29803) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/12 06:41:08 (29901) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 06:41:32 (29925) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/12 06:41:32 (29925) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/12 06:41:32 (29925) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/12 06:46:33 (29939) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/12 06:46:33 (29939) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/12 06:46:33 (29939) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/12 06:50:46 (29969) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 06:51:34 (29976) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/12 06:51:34 (29976) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/12 06:51:34 (29976) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/12 06:56:35 (29989) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/12 06:56:35 (29989) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/12 06:56:35 (29989) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/12 07:01:11 (30081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 07:01:36 (30094) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/12 07:01:36 (30094) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/12 07:01:36 (30094) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/12 07:06:37 (30121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/12 07:06:37 (30121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/12 07:06:37 (30121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/12 07:10:22 (30206) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 07:11:38 (30234) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/12 07:11:38 (30234) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/12 07:11:38 (30234) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/12 07:16:39 (30270) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/12 07:16:39 (30270) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/12 07:16:39 (30270) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/12 07:20:54 (30362) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 07:21:40 (30368) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/12 07:21:40 (30368) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/12 07:21:40 (30368) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/12 07:26:41 (30406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/12 07:26:41 (30406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/12 07:26:41 (30406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/12 07:31:23 (30436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 07:31:42 (30454) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/12 07:31:42 (30454) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/12 07:31:42 (30454) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/12 07:36:43 (30506) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/12 07:36:43 (30506) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/12 07:36:43 (30506) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/12 07:41:44 (30587) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/12 07:41:44 (30587) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/12 07:41:44 (30587) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/12 07:41:56 (30589) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 07:46:45 (30686) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/12 07:46:45 (30686) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/12 07:46:45 (30686) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/12 07:51:46 (30700) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/12 07:51:46 (30700) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/12 07:51:46 (30700) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/12 07:52:19 (30725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 07:56:47 (30737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/12 07:56:47 (30737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/12 07:56:47 (30737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/12 08:01:48 (30821) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/12 08:01:48 (30821) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/12 08:01:48 (30821) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/12 08:02:18 (30846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 08:06:49 (30939) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/12 08:06:49 (30939) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/12 08:06:49 (30939) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/12 08:11:50 (30987) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/12 08:11:50 (30987) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/12 08:11:50 (30987) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/12 08:11:52 (31003) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 08:16:51 (31080) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/12 08:16:51 (31080) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/12 08:16:51 (31080) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/12 08:21:52 (31114) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/12 08:21:52 (31114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/12 08:21:52 (31114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/12 08:22:07 (31118) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 08:26:54 (31132) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/12 08:26:54 (31132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/12 08:26:54 (31132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/12 08:31:54 (31147) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/12 08:31:54 (31147) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/12 08:31:54 (31147) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/12 08:32:24 (31174) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 08:36:55 (31212) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/12 08:36:55 (31212) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/12 08:36:55 (31212) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/12 08:41:53 (31250) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 08:41:56 (31256) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/12 08:41:56 (31256) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/12 08:41:56 (31256) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624559639.957183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624559641.959700
2015/05/12 08:46:57 (31343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/12 08:46:57 (31343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/12 08:46:57 (31343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624559698.264441
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6019 - canceling
bwctl: stop_endpoint: 3624559700.266928
2015/05/12 08:51:41 (31373) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 08:51:58 (31380) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/12 08:51:58 (31380) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/12 08:51:58 (31380) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624453464.933067
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624453466.935546
2015/05/12 08:56:59 (31395) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/12 08:56:59 (31395) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/12 08:56:59 (31395) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624560240.602791
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624560242.603528
2015/05/12 09:01:11 (31492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 09:02:00 (31503) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/12 09:02:00 (31503) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/12 09:02:00 (31503) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624351664.291807
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624351666.294271
2015/05/12 09:07:01 (31543) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/12 09:07:01 (31543) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/12 09:07:01 (31543) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624560799.298473
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624560801.300892
2015/05/12 09:10:28 (31576) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 09:12:02 (31590) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/12 09:12:02 (31590) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/12 09:12:02 (31590) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624560906.262991
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624560908.265482
2015/05/12 09:17:03 (31662) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/12 09:17:03 (31662) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/12 09:17:03 (31662) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453769.392733
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6046 - canceling
bwctl: stop_endpoint: 3624453771.395367
2015/05/12 09:21:26 (31717) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 09:22:04 (31724) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/12 09:22:04 (31724) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/12 09:22:04 (31724) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624561436.254200
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624561438.256680
2015/05/12 09:27:05 (31733) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/12 09:27:05 (31733) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/12 09:27:05 (31733) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351820.281879
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624351822.284309
2015/05/12 09:31:59 (31768) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 09:32:06 (31774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/12 09:32:06 (31774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/12 09:32:06 (31774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624454341.247800
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624454343.250278
2015/05/12 09:37:07 (31805) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/12 09:37:07 (31805) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/12 09:37:07 (31805) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454387.983709
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624454389.986199
2015/05/12 09:42:08 (31832) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/12 09:42:08 (31832) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/12 09:42:08 (31832) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624390570.354833
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6005 - canceling
bwctl: stop_endpoint: 3624390572.357322
2015/05/12 09:42:57 (31854) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 09:47:09 (31924) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/12 09:47:09 (31924) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/12 09:47:09 (31924) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624454965.736874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624454967.739364
2015/05/12 09:52:10 (31959) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/12 09:52:10 (31959) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/12 09:52:10 (31959) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328958.844492
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624328960.845841
2015/05/12 09:52:44 (31983) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 09:57:11 (32000) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/12 09:57:11 (32000) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/12 09:57:11 (32000) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624329112.835526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624329114.838006
2015/05/12 10:02:12 (32074) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/12 10:02:12 (32074) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/12 10:02:12 (32074) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624455572.391018
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6046 - canceling
bwctl: stop_endpoint: 3624455574.393512
2015/05/12 10:03:06 (32105) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 10:07:13 (32140) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/12 10:07:13 (32140) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/12 10:07:13 (32140) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329403.902978
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624329405.905450
2015/05/12 10:12:14 (32161) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/12 10:12:14 (32161) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/12 10:12:14 (32161) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624455914.577045
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624455916.579513
2015/05/12 10:12:34 (32182) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 10:17:16 (32240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/12 10:17:16 (32240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/12 10:17:16 (32240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624456175.793043
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624456177.795537
2015/05/12 10:22:16 (32323) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/12 10:22:16 (32323) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/12 10:22:16 (32323) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624352963.995259
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624352965.997751
2015/05/12 10:22:27 (32324) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 10:27:17 (32341) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/12 10:27:17 (32341) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/12 10:27:17 (32341) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624565101.529566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624565103.532052
2015/05/12 10:32:18 (32354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/12 10:32:18 (32354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/12 10:32:18 (32354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624565166.527373
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6060 - canceling
bwctl: stop_endpoint: 3624565168.529853
2015/05/12 10:32:49 (32381) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 10:37:19 (32418) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/12 10:37:19 (32418) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/12 10:37:19 (32418) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624456521.785526
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624456523.788008
2015/05/12 10:42:20 (32439) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/12 10:42:20 (32439) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/12 10:42:20 (32439) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624565546.097856
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624565548.100327
2015/05/12 10:43:38 (32465) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 10:47:21 (32478) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/12 10:47:21 (32478) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/12 10:47:21 (32478) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624391929.727142
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624391931.729597
2015/05/12 10:52:22 (32569) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/12 10:52:22 (32569) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/12 10:52:22 (32569) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624315431.884612
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624315433.887089
2015/05/12 10:53:11 (32593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 10:57:23 (32607) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/12 10:57:23 (32607) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/12 10:57:23 (32607) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624392515.863758
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624392517.866249
2015/05/12 11:02:24 (32684) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/12 11:02:24 (32684) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/12 11:02:24 (32684) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624457448.390477
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624457450.392953
2015/05/12 11:02:53 (32714) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 11:07:25 (32747) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/12 11:07:25 (32747) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/12 11:07:25 (32747) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624566792.933603
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624566794.936084
2015/05/12 11:12:26 (32767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/12 11:12:26 (32767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/12 11:12:26 (32767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624566846.498222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624566848.499466
2015/05/12 11:13:13 (323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 11:17:27 (338) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/12 11:17:27 (338) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/12 11:17:27 (338) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624329986.665967
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624329988.667411
2015/05/12 11:22:28 (433) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/12 11:22:28 (433) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/12 11:22:28 (433) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567381.019610
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3624567383.021658
2015/05/12 11:22:52 (455) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 11:27:29 (466) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/12 11:27:29 (466) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/12 11:27:29 (466) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624457754.985432
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624457756.987921
2015/05/12 11:32:30 (488) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/12 11:32:30 (488) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/12 11:32:30 (488) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624567925.858750
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624567927.861559
2015/05/12 11:33:17 (516) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 11:37:31 (540) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/12 11:37:31 (540) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/12 11:37:31 (540) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624568038.829288
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624568040.831773
2015/05/12 11:42:32 (564) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/12 11:42:32 (564) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/12 11:42:32 (564) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624393019.520501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624393021.522974
2015/05/12 11:43:21 (586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 11:47:33 (596) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/12 11:47:33 (596) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/12 11:47:33 (596) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458058.688789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624458060.691270
2015/05/12 11:52:34 (677) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/12 11:52:34 (677) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/12 11:52:34 (677) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624393129.221309
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624393131.223812
2015/05/12 11:53:53 (717) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 11:57:35 (730) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/12 11:57:35 (730) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/12 11:57:35 (730) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624458384.543258
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624458386.545743
2015/05/12 12:02:36 (811) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/12 12:02:36 (811) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/12 12:02:36 (811) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624304463.118345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624304465.119034
2015/05/12 12:04:23 (847) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 12:07:37 (876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/12 12:07:37 (876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/12 12:07:37 (876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624458712.144701
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624458714.147177
2015/05/12 12:12:38 (892) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/12 12:12:38 (892) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/12 12:12:38 (892) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624353977.047882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6059 - canceling
bwctl: stop_endpoint: 3624353979.048701
2015/05/12 12:13:49 (914) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 12:17:40 (934) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/12 12:17:40 (934) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/12 12:17:40 (934) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624570428.354537
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624570430.357028
2015/05/12 12:22:40 (1003) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/12 12:22:40 (1003) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/12 12:22:40 (1003) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624570520.342120
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624570522.344611
2015/05/12 12:23:27 (1029) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 12:27:41 (1065) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/12 12:27:41 (1065) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/12 12:27:41 (1065) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459217.093509
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624459219.096022
2015/05/12 12:32:42 (1080) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/12 12:32:42 (1080) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/12 12:32:42 (1080) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624570966.652711
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624570968.655196
2015/05/12 12:34:00 (1108) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 12:37:43 (1141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/12 12:37:43 (1141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/12 12:37:43 (1141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624571003.165489
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624571005.167972
2015/05/12 12:42:44 (1168) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/12 12:42:44 (1168) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/12 12:42:44 (1168) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624571098.207088
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624571100.209581
2015/05/12 12:43:38 (1196) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 12:47:45 (1209) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/12 12:47:45 (1209) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/12 12:47:45 (1209) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459363.971187
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624459365.973680
2015/05/12 12:52:46 (1291) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/12 12:52:46 (1291) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/12 12:52:46 (1291) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624459575.617327
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624459577.618419
2015/05/12 12:54:07 (1347) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 12:57:47 (1441) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/12 12:57:47 (1441) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/12 12:57:47 (1441) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624459759.073431
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624459761.075923
2015/05/12 13:02:48 (1535) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/12 13:02:48 (1535) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/12 13:02:48 (1535) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572217.572769
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624572219.575249
2015/05/12 13:04:44 (1574) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 13:07:49 (1599) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/12 13:07:49 (1599) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/12 13:07:49 (1599) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624572294.456183
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6015 - canceling
bwctl: stop_endpoint: 3624572296.458659
2015/05/12 13:12:50 (1623) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/12 13:12:50 (1623) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/12 13:12:50 (1623) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624459928.917806
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624459930.920277
2015/05/12 13:15:33 (1654) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 13:17:51 (1665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/12 13:17:51 (1665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/12 13:17:51 (1665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624572853.688055
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3624572855.690654
2015/05/12 13:22:52 (1685) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/12 13:22:52 (1685) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/12 13:22:52 (1685) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624354227.020964
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624354229.023448
2015/05/12 13:25:18 (1767) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 13:27:53 (1797) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/12 13:27:53 (1797) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/12 13:27:53 (1797) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573349.121472
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624573351.123952
2015/05/12 13:32:54 (1813) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/12 13:32:54 (1813) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/12 13:32:54 (1813) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460304.169249
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624460306.171723
2015/05/12 13:36:02 (1874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 13:37:55 (1884) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/12 13:37:55 (1884) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/12 13:37:55 (1884) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624573906.396690
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624573908.399168
2015/05/12 13:42:56 (1919) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/12 13:42:56 (1919) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/12 13:42:56 (1919) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624573993.395170
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624573995.397651
2015/05/12 13:47:01 (1947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 13:47:57 (1954) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/12 13:47:57 (1954) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/12 13:47:57 (1954) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394215.334103
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624394217.336601
2015/05/12 13:52:58 (1971) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/12 13:52:58 (1971) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/12 13:52:58 (1971) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624460742.068475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624460744.069673
2015/05/12 13:57:55 (2085) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 13:57:59 (2091) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/12 13:57:59 (2091) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/12 13:57:59 (2091) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624574612.457311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624574614.459793
2015/05/12 14:03:00 (2181) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/12 14:03:00 (2181) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/12 14:03:00 (2181) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624460961.169442
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624460963.171944
2015/05/12 14:07:27 (2243) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 14:08:02 (2257) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/12 14:08:02 (2257) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/12 14:08:02 (2257) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624330316.164845
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624330318.167324
2015/05/12 14:13:03 (2280) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/12 14:13:03 (2280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/12 14:13:03 (2280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624575215.683392
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6037 - canceling
bwctl: stop_endpoint: 3624575217.685862
2015/05/12 14:16:38 (2308) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 14:18:04 (2317) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/12 14:18:04 (2317) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/12 14:18:04 (2317) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461305.442689
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624461307.445179
2015/05/12 14:23:05 (2340) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/12 14:23:05 (2340) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/12 14:23:05 (2340) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624575788.810023
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624575790.811025
2015/05/12 14:26:44 (2406) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 14:28:06 (2431) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/12 14:28:06 (2431) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/12 14:28:06 (2431) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624394757.874550
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624394759.877037
2015/05/12 14:33:07 (2468) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/12 14:33:07 (2468) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/12 14:33:07 (2468) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624461684.197392
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624461686.198121
2015/05/12 14:37:15 (2523) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 14:38:08 (2531) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/12 14:38:08 (2531) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/12 14:38:08 (2531) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624461880.444019
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624461882.446503
2015/05/12 14:43:09 (2550) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/12 14:43:09 (2550) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/12 14:43:09 (2550) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624315913.648797
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624315915.651292
2015/05/12 14:46:57 (2579) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 14:48:10 (2586) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/12 14:48:10 (2586) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/12 14:48:10 (2586) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624577066.705317
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624577068.707795
2015/05/12 14:53:11 (2610) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/12 14:53:11 (2610) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/12 14:53:11 (2610) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462212.110300
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624462214.112791
2015/05/12 14:56:48 (2638) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 14:58:12 (2682) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/12 14:58:12 (2682) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/12 14:58:12 (2682) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624577667.063517
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624577669.066001
2015/05/12 15:03:13 (2881) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/12 15:03:13 (2881) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/12 15:03:13 (2881) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624330753.327083
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624330755.329573
2015/05/12 15:06:25 (2943) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:08:14 (2961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/12 15:08:14 (2961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/12 15:08:14 (2961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624462800.806312
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624462802.808809
2015/05/12 15:14:40 (7806) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/12 15:14:40 (7806) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/12 15:14:40 (7806) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624578348.702457
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624578350.704955
2015/05/12 15:15:40 (8200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:19:41 (8297) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/12 15:19:41 (8297) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/12 15:19:41 (8297) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395380.436555
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624395382.439034
2015/05/12 15:24:42 (8308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/12 15:24:42 (8308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/12 15:24:42 (8308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624355177.659308
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624355179.661797
2015/05/12 15:29:43 (8422) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/12 15:29:43 (8422) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/12 15:29:43 (8422) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624308415.974724
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624308417.977218
2015/05/12 15:34:44 (8518) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/12 15:34:44 (8518) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/12 15:34:44 (8518) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624579468.455291
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624579470.457762
2015/05/12 15:39:45 (9031) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/12 15:39:45 (9031) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/12 15:39:45 (9031) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624395987.945646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6052 - canceling
bwctl: stop_endpoint: 3624395989.948126
2015/05/12 15:44:07 (9134) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/12 15:44:07 (9134) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/12 15:44:07 (9134) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624304591.586564
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624304593.589109
2015/05/12 15:44:27 (9196) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:44:50 (9271) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:44:51 (9280) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:45:00 (9286) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:45:02 (9295) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:45:31 (9131) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x4211700)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x4211700)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x4224138)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x42...', 'HASH(0x4224390)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4223da8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x421db68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x421db68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x42005f8)', 'handle_results', 'CODE(0x3922f60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x41f1130)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 15:46:00 (9131) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x422c088)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x422c088)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x42246f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x42...', 'HASH(0x4224828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4223da8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x421db68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x42111c0)', 'HASH(0x421db68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x42005f8)', 'handle_results', 'CODE(0x3922f60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x41f1130)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 15:49:08 (9336) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/12 15:49:08 (9336) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/12 15:49:08 (9336) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624580651.137566
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624580653.140039
2015/05/12 15:52:45 (9893) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/12 15:52:45 (9893) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/12 15:52:45 (9893) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624464542.065500
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624464544.067979
2015/05/12 15:53:04 (9994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:53:13 (10000) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:53:19 (10009) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:53:42 (10025) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:53:54 (10031) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 15:54:25 (9892) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x48eb7e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x48eb7e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x49103d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x40...', 'HASH(0x48e34c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4910090)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x4907c10)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x4907c10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48f8cb8)', 'handle_results', 'CODE(0x400e080)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48dc350)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 15:55:23 (9892) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x4910a68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x4910a68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x4910b40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x49...', 'HASH(0x49107c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4910090)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x4907c10)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48fcb48)', 'HASH(0x4907c10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48f8cb8)', 'handle_results', 'CODE(0x400e080)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48dc350)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 15:57:46 (10074) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/12 15:57:46 (10074) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/12 15:57:46 (10074) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624396580.689929
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624396582.692399
2015/05/12 16:02:33 (10341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:02:47 (10354) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/12 16:02:47 (10354) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/12 16:02:47 (10354) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581303.099092
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624581305.101571
2015/05/12 16:02:53 (10367) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:03:18 (10382) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:03:32 (10407) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:04:08 (10437) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:07:48 (10532) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/12 16:07:48 (10532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/12 16:07:48 (10532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624396605.504802
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624396607.507289
2015/05/12 16:11:49 (10549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:12:49 (10578) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/12 16:12:49 (10578) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/12 16:12:49 (10578) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624581868.379100
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3624581870.381582
2015/05/12 16:13:42 (10587) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:13:49 (10593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:14:09 (10605) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:14:51 (10633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:17:51 (10740) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/12 16:17:51 (10740) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/12 16:17:51 (10740) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624581884.528066
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624581886.530542
2015/05/12 16:22:39 (10799) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:22:52 (10810) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/12 16:22:52 (10810) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/12 16:22:52 (10810) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624355794.891748
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624355796.894217
2015/05/12 16:24:33 (10848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:24:35 (10854) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:24:36 (10860) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:25:21 (10929) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/12 16:25:21 (10929) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/12 16:25:21 (10929) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624582468.159936
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624582470.162428
2015/05/12 16:25:40 (11066) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:25:42 (11071) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:25:44 (10928) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x431ea78)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x431ea78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x42fb710)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x43...', 'HASH(0x4302730)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x431e4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x43178b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x43178b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4306380)', 'handle_results', 'CODE(0x3a1e160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x42ec250)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 16:25:52 (11086) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:25:56 (11092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:26:15 (11099) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:27:00 (10928) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x43265e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x43265e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x431ed18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x43...', 'HASH(0x431ec88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x431e4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x43178b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x430b528)', 'HASH(0x43178b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4306380)', 'handle_results', 'CODE(0x3a1e160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x42ec250)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 16:27:32 (11178) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/12 16:27:32 (11178) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/12 16:27:32 (11178) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624356038.758863
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624356040.761334
2015/05/12 16:27:51 (11302) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:27:58 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1b68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1b68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1a48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48dc478)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 16:27:58 (11335) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:28:02 (11359) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:28:18 (11363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:28:31 (11371) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:28:59 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e20d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e20d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e21c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1fe8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 16:31:40 (11495) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:32:33 (11528) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/12 16:32:33 (11528) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/12 16:32:33 (11528) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624465774.705085
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624465776.707567
2015/05/12 16:36:48 (11557) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:37:03 (11581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:37:34 (11589) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/12 16:37:34 (11589) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/12 16:37:34 (11589) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624397231.160246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3624397233.162738
2015/05/12 16:38:05 (11595) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:38:46 (11625) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:38:57 (11634) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:42:35 (11650) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/12 16:42:35 (11650) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/12 16:42:35 (11650) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624331566.031095
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624331568.033590
2015/05/12 16:46:34 (11673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:47:08 (11683) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:47:32 (11692) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:47:37 (11698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/12 16:47:37 (11698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/12 16:47:37 (11698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624316535.513068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624316537.515564
2015/05/12 16:48:38 (11721) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:49:04 (11734) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:52:38 (11750) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/12 16:52:38 (11750) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/12 16:52:38 (11750) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624584154.576008
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624584156.576568
2015/05/12 16:56:27 (11762) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:56:31 (11768) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:57:39 (11791) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/12 16:57:39 (11791) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/12 16:57:39 (11791) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584283.032780
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624584285.035264
2015/05/12 16:58:11 (11816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:58:19 (11822) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:58:33 (11834) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 16:58:50 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1aa8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1aa8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2570)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48c2af8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 17:00:38 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2570)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2570)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1b50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e2630)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 17:01:02 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496b278)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496b278)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496b290)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x4904c98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 17:01:40 (11930) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:02:40 (11999) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/12 17:02:40 (11999) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/12 17:02:40 (11999) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624466922.142641
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624466924.145144
2015/05/12 17:05:47 (12033) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:07:17 (12059) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:07:24 (12065) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:07:41 (12073) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/12 17:07:41 (12073) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/12 17:07:41 (12073) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624584840.999011
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624584843.001497
2015/05/12 17:08:54 (12114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:08:58 (12123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:12:42 (12139) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/12 17:12:42 (12139) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/12 17:12:42 (12139) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624584847.289587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624584849.292173
2015/05/12 17:16:23 (12149) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:17:22 (12160) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:17:43 (12186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/12 17:17:43 (12186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/12 17:17:43 (12186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624397844.126399
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624397846.128886
2015/05/12 17:18:00 (12191) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:18:07 (12200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:19:26 (12225) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:22:44 (12241) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/12 17:22:44 (12241) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/12 17:22:44 (12241) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624356923.974365
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6045 - canceling
bwctl: stop_endpoint: 3624356925.976866
2015/05/12 17:25:55 (12249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:27:37 (12260) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:27:45 (12270) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/12 17:27:45 (12270) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/12 17:27:45 (12270) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624585468.481999
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624585470.484490
2015/05/12 17:27:57 (12291) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:28:08 (12312) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:28:37 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48ec5d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48ec5d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48f7928)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e12d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 17:28:53 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e8060)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e8060)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1df0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e2330)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 17:29:36 (12329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:32:25 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1a00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1a00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48dc790)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1da8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 17:32:46 (12375) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/12 17:32:46 (12375) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/12 17:32:46 (12375) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398266.593621
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624398268.596092
2015/05/12 17:33:33 (12396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:36:35 (12462) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:37:05 (12497) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:37:27 (12527) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:37:36 (12533) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:37:47 (12542) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/12 17:37:47 (12542) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/12 17:37:47 (12542) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624398442.659749
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3624398444.662226
2015/05/12 17:40:26 (12552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:42:48 (12564) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/12 17:42:48 (12564) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/12 17:42:48 (12564) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624357193.505633
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624357195.508133
2015/05/12 17:46:27 (12591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:46:28 (12600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:47:21 (12626) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:47:49 (12633) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/12 17:47:49 (12633) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/12 17:47:49 (12633) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624398827.566815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624398829.569303
2015/05/12 17:48:35 (12637) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:50:48 (12653) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:52:50 (12664) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:52:50 (12664) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 17:52:50 (12664) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 17:52:50 (12664) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 17:56:28 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48fe6f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48fe6f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x493e530)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e0a48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 17:56:52 (12676) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:57:09 (12720) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:57:27 (12726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:57:51 (12737) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/12 17:57:51 (12737) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/12 17:57:51 (12737) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624586692.522300
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624586694.524788
2015/05/12 17:58:41 (12741) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 17:59:29 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3ed2948)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3ed2948)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1a78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 18:01:39 (12826) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:02:52 (12861) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:02:52 (12861) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 18:02:52 (12861) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 18:02:52 (12861) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 18:03:26 (12872) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:03:31 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48bfb28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48bfb28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1f10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48adc10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 18:06:36 (12972) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:07:24 (12991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:07:53 (13020) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/12 18:07:53 (13020) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/12 18:07:53 (13020) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624399063.735170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624399065.737666
2015/05/12 18:08:08 (13021) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:09:01 (13034) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:11:26 (13049) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:12:54 (13060) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:12:55 (13060) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 18:12:55 (13060) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 18:12:55 (13060) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 18:16:41 (13072) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:17:27 (13098) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:17:55 (13105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/12 18:17:55 (13105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/12 18:17:55 (13105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624587051.084478
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624587053.086974
2015/05/12 18:18:14 (13109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:18:47 (13135) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:21:32 (13154) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:22:56 (13165) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/12 18:22:56 (13165) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/12 18:22:56 (13165) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587183.661715
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3624587185.664194
2015/05/12 18:26:12 (13173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:26:35 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48f7b08)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48f7b08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48e1330)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x49048d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 18:26:57 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48adc58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48adc58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e23f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1e50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 18:27:12 (13202) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:27:57 (13209) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/12 18:27:57 (13209) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/12 18:27:57 (13209) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624469314.273156
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624469316.275631
2015/05/12 18:28:38 (13213) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:29:36 (13240) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:32:07 (13259) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:32:58 (13297) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/12 18:32:58 (13297) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/12 18:32:58 (13297) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624316740.938169
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624316742.940665
2015/05/12 18:33:02 (13298) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:34:13 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1f58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1f58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e7988)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1b20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 18:36:04 (13369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:36:15 (13379) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:37:59 (13432) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/12 18:37:59 (13432) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/12 18:37:59 (13432) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624587813.504914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624587815.507403
2015/05/12 18:39:12 (13437) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:39:59 (13464) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:42:23 (13482) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:43:00 (13492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:43:00 (13492) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 18:43:00 (13492) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 18:43:00 (13492) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 18:46:57 (13521) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:46:57 (13522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:48:01 (13534) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/12 18:48:01 (13534) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/12 18:48:01 (13534) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624587877.048473
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624587879.050950
2015/05/12 18:48:48 (13538) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:50:00 (13566) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:52:37 (13584) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:53:02 (13594) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:53:02 (13594) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 18:53:02 (13594) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 18:53:02 (13594) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 18:54:22 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x490a050)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x490a050)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496fb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e0cb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 18:55:57 (13606) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:56:30 (13615) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:57:20 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3ed2948)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3ed2948)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e8060)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 18:58:03 (13640) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/12 18:58:03 (13640) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/12 18:58:03 (13640) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624469618.172776
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624469620.175265
2015/05/12 18:58:50 (13645) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 18:59:41 (13671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:01:43 (13757) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:02:44 (13801) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:03:04 (13811) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:03:04 (13811) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 19:03:04 (13811) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 19:03:04 (13811) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 19:03:51 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e20a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e20a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1c70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x3338df8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 19:05:20 (13822) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:06:52 (13877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:08:05 (13930) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/12 19:08:05 (13930) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/12 19:08:05 (13930) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624357495.262602
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624357497.265082
2015/05/12 19:08:31 (13934) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:10:14 (13970) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:13:06 (13982) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:13:06 (13982) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 19:13:06 (13982) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 19:13:06 (13982) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 19:13:20 (13988) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:14:52 (14005) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:16:49 (14031) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:17:48 (14041) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:18:07 (14048) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/12 19:18:07 (14048) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/12 19:18:07 (14048) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624470041.441279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624470043.443768
2015/05/12 19:20:52 (14076) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:23:08 (14087) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/12 19:23:08 (14087) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/12 19:23:08 (14087) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624589020.080206
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624589022.082689
2015/05/12 19:23:35 (14091) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:23:58 (14104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:24:32 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e8030)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e8030)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1a18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e2828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 19:25:19 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4923530)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4923530)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x494cee8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x4950a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 19:27:01 (14136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:27:42 (14145) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:28:09 (14152) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/12 19:28:09 (14152) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/12 19:28:09 (14152) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624589068.165592
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624589070.168076
2015/05/12 19:28:54 (14158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:31:37 (14200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:31:49 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48dc808)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48dc808)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2378)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e22e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 19:33:10 (14237) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/12 19:33:10 (14237) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/12 19:33:10 (14237) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332179.772261
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624332181.774757
2015/05/12 19:34:19 (14242) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:34:48 (14255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:36:25 (14287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:36:52 (14301) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:38:11 (14335) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/12 19:38:11 (14335) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/12 19:38:11 (14335) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624470535.016449
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624470537.018929
2015/05/12 19:41:24 (14403) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:43:12 (14414) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/12 19:43:12 (14414) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/12 19:43:12 (14414) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624470812.527904
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624470814.530379
2015/05/12 19:44:00 (14419) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:44:33 (14428) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:46:06 (14461) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:46:15 (14467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:48:14 (14475) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/12 19:48:14 (14475) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/12 19:48:14 (14475) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624309003.972739
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624309005.975218
2015/05/12 19:50:45 (14502) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:53:14 (14514) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/12 19:53:14 (14514) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/12 19:53:14 (14514) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624471134.543876
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624471136.546361
2015/05/12 19:54:22 (14519) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:55:31 (14545) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:55:40 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2288)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2288)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1b08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e7d48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 19:55:48 (14559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:56:25 (14573) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:56:35 (14589) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 19:57:51 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x492b358)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x492b358)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4963c18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x4904cf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 19:58:15 (14599) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/12 19:58:15 (14599) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/12 19:58:15 (14599) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624590864.133016
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624590866.135488
2015/05/12 19:58:58 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e8060)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e8060)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2690)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48adc88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 20:01:43 (14696) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:03:16 (14731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:03:16 (14731) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 20:03:16 (14731) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 20:03:16 (14731) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 20:03:34 (14737) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:05:13 (14764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:05:31 (14776) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:06:22 (14792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:08:17 (14814) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/12 20:08:17 (14814) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/12 20:08:17 (14814) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624591163.546725
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624591165.549212
2015/05/12 20:11:48 (14900) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:13:18 (14911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:13:18 (14911) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 20:13:18 (14911) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 20:13:18 (14911) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 20:14:29 (14921) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:15:24 (14950) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:15:24 (14951) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:15:54 (14966) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:18:19 (14977) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/12 20:18:19 (14977) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/12 20:18:19 (14977) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624471176.819372
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624471178.821153
2015/05/12 20:22:13 (15006) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:23:20 (15016) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/12 20:23:20 (15016) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/12 20:23:20 (15016) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400286.371520
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624400288.373998
2015/05/12 20:23:50 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2618)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2618)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48c2af8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 20:24:43 (15027) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:24:54 (15033) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:25:28 (15061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:25:31 (15067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:26:43 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496f830)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496f830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496f170)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x496a390)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 20:27:40 (15084) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:28:21 (15101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/12 20:28:21 (15101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/12 20:28:21 (15101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624358116.523787
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6042 - canceling
bwctl: stop_endpoint: 3624358118.526296
2015/05/12 20:30:59 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2078)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2078)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e27e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e8090)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 20:32:58 (15157) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:33:22 (15166) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/12 20:33:22 (15166) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/12 20:33:22 (15166) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624400828.972218
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624400830.974704
2015/05/12 20:35:30 (15194) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:35:35 (15200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:35:42 (15206) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:36:07 (15222) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:38:23 (15245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/12 20:38:23 (15245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/12 20:38:23 (15245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624401128.995742
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3624401130.998227
2015/05/12 20:43:24 (15337) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/12 20:43:24 (15337) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/12 20:43:24 (15337) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624592676.477853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624592678.480328
2015/05/12 20:43:41 (15338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:44:45 (15351) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:46:09 (15377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:46:25 (15389) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:46:34 (15398) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:48:25 (15406) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:48:25 (15406) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 20:48:25 (15406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 20:48:25 (15406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 20:52:09 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2018)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2018)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48dc778)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e8168)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 20:53:04 (15440) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:53:26 (15450) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/12 20:53:26 (15450) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/12 20:53:26 (15450) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624472553.123321
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3624472555.125802
2015/05/12 20:54:32 (15459) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:54:52 (15467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:54:56 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496fbd8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x496fbd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x491ef78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x4984600)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 20:55:51 (15487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:56:53 (15512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:57:12 (15522) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:58:27 (15532) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 20:58:27 (15532) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 20:58:27 (15532) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 20:58:27 (15532) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 21:02:40 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1ef8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1ef8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48c0188)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e2480)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 21:02:47 (15632) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:03:28 (15666) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/12 21:03:28 (15666) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/12 21:03:28 (15666) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624317092.596997
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6024 - canceling
bwctl: stop_endpoint: 3624317094.599501
2015/05/12 21:04:44 (15672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:05:05 (15682) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:06:55 (15716) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:07:04 (15725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:08:29 (15745) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:08:30 (15745) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 21:08:30 (15745) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 21:08:30 (15745) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 21:11:52 (15815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:13:31 (15849) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/12 21:13:31 (15849) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/12 21:13:31 (15849) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624332790.776841
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624332792.778818
2015/05/12 21:14:51 (15857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:15:27 (15867) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:16:32 (15877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:17:07 (15890) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:18:31 (15912) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/12 21:18:31 (15912) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/12 21:18:31 (15912) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624593582.472908
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624593584.475399
2015/05/12 21:20:32 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e79b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e79b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1b20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e8240)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 21:20:57 (15941) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:21:44 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4919b78)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4919b78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x497f7f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x4937230)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 21:23:32 (15956) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/12 21:23:32 (15956) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/12 21:23:32 (15956) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624358992.297637
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624358994.300121
2015/05/12 21:24:59 (15962) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:25:48 (15974) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:25:58 (15981) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:26:29 (15994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:26:51 (16013) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:28:33 (16036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:28:33 (16036) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 21:28:33 (16036) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 21:28:33 (16036) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 21:31:29 (16066) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:32:45 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48af430)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48af430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1d78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48dc6d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 21:33:34 (16103) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/12 21:33:34 (16103) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/12 21:33:34 (16103) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624317135.822633
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624317137.825117
2015/05/12 21:34:09 (16109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:35:20 (16119) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:36:26 (16138) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:36:44 (16147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:38:35 (16182) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:38:35 (16182) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 21:38:35 (16182) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 21:38:35 (16182) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 21:42:05 (16218) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:43:36 (16281) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/12 21:43:36 (16281) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/12 21:43:36 (16281) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624359363.785273
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6055 - canceling
bwctl: stop_endpoint: 3624359365.787736
2015/05/12 21:43:48 (16282) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:46:09 (16305) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:46:22 (16314) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:46:50 (16338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:47:32 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1c70)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1c70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e7e68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e25a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 21:48:37 (16348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:48:37 (16348) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 21:48:37 (16348) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 21:48:37 (16348) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 21:52:38 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x492ac20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x492ac20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x497fcb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x4951168)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 21:52:47 (16381) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:53:17 (16394) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:53:38 (16400) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/12 21:53:38 (16400) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/12 21:53:38 (16400) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474105.988469
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624474107.990954
2015/05/12 21:55:25 (16408) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:57:15 (16443) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:57:18 (16449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:57:47 (16456) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 21:58:39 (16473) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/12 21:58:39 (16473) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/12 21:58:39 (16473) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624594924.922968
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624594926.925454
2015/05/12 22:02:39 (16572) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:02:46 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e28e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e28e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2240)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e8108)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 22:02:50 (16583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:03:40 (16614) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/12 22:03:40 (16614) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/12 22:03:40 (16614) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624594957.406191
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624594959.408677
2015/05/12 22:05:18 (16621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:07:26 (16661) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:07:32 (16667) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:08:41 (16684) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:08:41 (16684) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 22:08:41 (16684) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 22:08:41 (16684) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 22:13:02 (16724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:13:11 (16731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:13:42 (16760) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/12 22:13:42 (16760) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/12 22:13:42 (16760) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624474143.344106
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624474145.346618
2015/05/12 22:14:21 (16785) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:15:42 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2240)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2240)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e20c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1e08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 22:16:41 (16836) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:17:27 (16846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:18:43 (16853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:18:43 (16853) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 22:18:43 (16853) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 22:18:43 (16853) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 22:21:51 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4933e10)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4933e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48f8360)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x491ef78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 22:22:05 (16869) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:23:44 (16897) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/12 22:23:44 (16897) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/12 22:23:44 (16897) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624595426.806922
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624595428.809410
2015/05/12 22:23:46 (16898) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:24:33 (16911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:26:21 (16925) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:27:31 (16951) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:28:23 (16971) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:28:45 (16977) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:28:45 (16977) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 22:28:45 (16977) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 22:28:45 (16977) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 22:32:45 (16994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:33:40 (17045) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:33:46 (17054) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/12 22:33:46 (17054) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/12 22:33:46 (17054) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624595570.603323
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6003 - canceling
bwctl: stop_endpoint: 3624595572.605193
2015/05/12 22:35:20 (17060) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:36:00 (17072) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:38:47 (17114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:38:47 (17114) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 22:38:48 (17114) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 22:38:48 (17114) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 22:39:16 (17123) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:43:23 (17161) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:43:27 (17173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:43:48 (17179) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/12 22:43:48 (17179) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/12 22:43:48 (17179) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624333103.895905
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3624333105.898388
2015/05/12 22:45:17 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48adc58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48adc58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e7a30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e27b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 22:45:29 (17224) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:46:28 (17268) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:48:50 (17280) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:48:50 (17280) ERROR> EsmondBase.pm:65 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing data (404) 404 NOT FOUND
2015/05/12 22:48:50 (17280) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing data: 404 NOT FOUND
2015/05/12 22:48:50 (17280) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing data: 404 NOT FOUND at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/MeasurementArchiveChild.pm line 122.
2015/05/12 22:49:32 (17287) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:51:08 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4933600)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4933600)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4947188)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x49634c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 22:53:20 (17327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:53:29 (17336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:53:50 (17342) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/12 22:53:50 (17342) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/12 22:53:50 (17342) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624596067.825078
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6061 - canceling
bwctl: stop_endpoint: 3624596069.827570
2015/05/12 22:55:26 (17348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:56:07 (17377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:56:22 (17396) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 22:57:14 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48b7088)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48b7088)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2210)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1d00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 22:58:51 (17406) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/12 22:58:51 (17406) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/12 22:58:51 (17406) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624474720.967814
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6023 - canceling
bwctl: stop_endpoint: 3624474722.970302
2015/05/12 22:59:30 (17411) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:03:49 (17520) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:03:52 (17526) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/12 23:03:52 (17526) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/12 23:03:52 (17526) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624474944.717803
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3624474946.720288
2015/05/12 23:04:15 (17548) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:05:08 (17561) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:05:40 (17573) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:08:53 (17615) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/12 23:08:53 (17615) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/12 23:08:53 (17615) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762035.727900
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633762037.730386
2015/05/12 23:10:09 (17627) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:13:54 (17640) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:13:55 (17646) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/12 23:13:55 (17646) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/12 23:13:55 (17646) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624364714.985506
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624364716.988004
2015/05/12 23:14:18 (17654) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:15:02 (17686) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:15:24 (17703) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:18:07 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1f88)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1f88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1e98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e7e68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 23:18:56 (17786) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/12 23:18:56 (17786) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/12 23:18:56 (17786) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633762633.960114
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633762635.962525
2015/05/12 23:19:49 (17791) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:22:20 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x49637c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x49637c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x49236c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e09d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 23:23:05 (17811) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:23:19 (17820) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:23:57 (17849) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/12 23:23:57 (17849) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/12 23:23:57 (17849) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633762633.854789
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3633762635.857275
2015/05/12 23:24:03 (17850) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:24:53 (17863) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:25:51 (17889) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:28:31 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48dc6a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48dc6a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e79b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 23:28:58 (17934) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/12 23:28:58 (17934) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/12 23:28:58 (17934) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635116719.385862
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635116719.385862
2015/05/12 23:29:18 (17939) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:33:27 (17977) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:33:35 (17983) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:33:59 (18019) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/12 23:33:59 (18019) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/12 23:33:59 (18019) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633762675.199866
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6004 - canceling
bwctl: stop_endpoint: 3633762677.202371
2015/05/12 23:34:06 (18021) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:35:06 (18035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:39:00 (18077) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/12 23:39:00 (18077) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/12 23:39:00 (18077) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624364887.840283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624364889.842774
2015/05/12 23:39:50 (18084) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:43:07 (18102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:43:34 (18131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:43:46 (18140) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:44:01 (18152) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/12 23:44:01 (18152) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/12 23:44:01 (18152) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635117512.899053
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3635117512.899053
2015/05/12 23:44:14 (18154) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:49:02 (18235) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/12 23:49:02 (18235) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/12 23:49:02 (18235) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624300329.588125
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3624300331.590637
2015/05/12 23:49:33 (18244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:51:04 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e22d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e22d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2000)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1d78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 23:52:09 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x495d710)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x495d710)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4959458)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x492b088)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 23:52:48 (18265) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:53:20 (18307) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:53:20 (18308) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:53:54 (18325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:54:03 (18331) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/12 23:54:03 (18331) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/12 23:54:03 (18331) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635118111.815161
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635118111.815161
2015/05/12 23:56:33 (18354) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/12 23:58:13 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2828)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e2828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1b80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x1d254e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/12 23:59:04 (18374) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/12 23:59:04 (18374) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/12 23:59:04 (18374) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624413620.431579
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624413622.434054
2015/05/13 00:00:27 (18428) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:02:22 (18467) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:02:55 (18476) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:03:14 (18506) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:04:05 (18518) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/13 00:04:05 (18518) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/13 00:04:05 (18518) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492034.336952
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624492036.339429
2015/05/13 00:04:15 (18544) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:09:06 (18654) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/13 00:09:06 (18654) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/13 00:09:06 (18654) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624492180.186529
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624492182.189002
2015/05/13 00:10:33 (18665) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:12:10 (18677) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:12:31 (18703) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:12:59 (18715) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:13:55 (18743) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:14:07 (18750) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/13 00:14:07 (18750) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/13 00:14:07 (18750) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624310093.906382
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3624310095.908889
2015/05/13 00:19:09 (18805) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/13 00:19:09 (18805) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/13 00:19:09 (18805) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624492595.775137
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624492597.777170
2015/05/13 00:20:16 (18834) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:21:37 (18865) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:21:46 (18871) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:23:20 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1ce8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1ce8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48c2af8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e8138)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 00:23:35 (18890) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:23:40 (18899) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:24:09 (18921) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/13 00:24:09 (18921) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/13 00:24:09 (18921) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633764998.723249
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6058 - canceling
bwctl: stop_endpoint: 3633765000.725721
2015/05/13 00:24:50 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48eba90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48eba90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x49308f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x496aaf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 00:28:09 (18932) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:28:50 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1bc8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1bc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1c88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1f58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 00:29:10 (18951) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/13 00:29:10 (18951) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/13 00:29:10 (18951) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624413925.937155
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624413925.953931
2015/05/13 00:30:34 (18966) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:31:15 (18994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:32:35 (19007) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:33:26 (19017) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:34:11 (19042) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/13 00:34:11 (19042) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/13 00:34:11 (19042) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624414073.467509
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624414075.469987
2015/05/13 00:34:20 (19067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:39:12 (19099) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/13 00:39:12 (19099) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/13 00:39:12 (19099) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624414183.436031
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624414185.438515
2015/05/13 00:40:24 (19110) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:41:00 (19136) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:43:13 (19152) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:43:33 (19161) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:44:13 (19168) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/13 00:44:13 (19168) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/13 00:44:13 (19168) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624493776.039702
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624493778.042190
2015/05/13 00:44:55 (19172) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:49:14 (19218) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/13 00:49:14 (19218) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/13 00:49:14 (19218) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633766225.943419
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3633766227.946145
2015/05/13 00:49:59 (19260) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:50:45 (19295) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:53:08 (19311) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:53:55 (19324) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:53:58 (19333) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:54:15 (19340) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/13 00:54:15 (19340) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/13 00:54:15 (19340) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635121623.178063
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6060 - canceling
bwctl: stop_endpoint: 3635121623.178063
2015/05/13 00:55:56 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e22d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e22d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e1c40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e7f88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 00:57:01 (11179) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x492afb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x492afb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x4958d08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x4923728)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc688)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48cc8f0)', 'HASH(0x48db8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48c31b8)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 00:58:29 (19368) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 00:59:16 (19405) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/13 00:59:16 (19405) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/13 00:59:16 (19405) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633766291.101435
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6035 - canceling
bwctl: stop_endpoint: 3633766293.103930
2015/05/13 00:59:23 (19406) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:00:35 (11176) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48dc478)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48dc478)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x48e25e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x48e1d90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x48dc4c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x48c8520)', 'HASH(0x3fd4418)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x48b7070)', 'handle_results', 'CODE(0x3fd9d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x48a8198)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 01:00:42 (19475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:03:57 (19512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:04:06 (19518) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:04:17 (19528) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/13 01:04:17 (19528) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/13 01:04:17 (19528) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494041.500657
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494043.503159
2015/05/13 01:04:47 (19532) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:05:24 (19613) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/13 01:05:24 (19613) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/13 01:05:24 (19613) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624319525.823524
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624319527.826019
2015/05/13 01:05:37 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5be9348)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c140a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 01:05:56 (19705) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:05:56 (19706) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:06:10 (19724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:06:13 (19753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:06:29 (19759) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:07:06 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c12ed0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c12ed0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5bdfed8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c13098)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 01:07:54 (19783) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:07:58 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c142b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14228)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 01:10:25 (19820) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/13 01:10:25 (19820) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/13 01:10:25 (19820) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624494581.247557
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6021 - canceling
bwctl: stop_endpoint: 3624494583.250052
2015/05/13 01:15:11 (19851) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:15:22 (19877) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:15:26 (19886) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/13 01:15:26 (19886) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/13 01:15:26 (19886) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635122994.724527
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3635122994.724527
2015/05/13 01:15:28 (19887) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:16:16 (19901) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:16:33 (19910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:20:27 (19941) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/13 01:20:27 (19941) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/13 01:20:27 (19941) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624336737.496998
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6048 - canceling
bwctl: stop_endpoint: 3624336739.499472
2015/05/13 01:24:13 (19992) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:25:28 (20034) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/13 01:25:28 (20034) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/13 01:25:28 (20034) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624495126.082860
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624495128.085351
2015/05/13 01:25:40 (20035) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:25:52 (20047) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:26:41 (20061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:27:00 (20070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:30:29 (20084) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/13 01:30:29 (20084) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/13 01:30:29 (20084) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635123611.057507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3635123611.057507
2015/05/13 01:34:45 (20131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:34:47 (20147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:34:47 (20148) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:35:14 (20166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:35:30 (20187) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/13 01:35:30 (20187) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/13 01:35:30 (20187) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624336823.474870
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624336825.477353
2015/05/13 01:35:42 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c7ba90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c7ba90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c19228)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c13b90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 01:37:02 (20207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:37:25 (20221) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:38:00 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14b58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14b58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13ef8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5bda640)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 01:38:35 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c142e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c142e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c141e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14708)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 01:40:31 (20252) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/13 01:40:31 (20252) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/13 01:40:31 (20252) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624495592.230962
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624495594.231518
2015/05/13 01:43:50 (20259) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:45:02 (20301) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:45:32 (20312) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/13 01:45:32 (20312) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/13 01:45:32 (20312) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415284.980002
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624415286.980808
2015/05/13 01:46:03 (20316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:47:10 (20329) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:47:55 (20339) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:50:34 (20355) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/13 01:50:34 (20355) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/13 01:50:34 (20355) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633768712.759880
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6062 - canceling
bwctl: stop_endpoint: 3633768714.762362
2015/05/13 01:53:59 (20419) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:55:21 (20466) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:55:24 (20475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:55:34 (20484) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/13 01:55:34 (20484) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/13 01:55:34 (20484) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624310370.906971
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624310372.909476
2015/05/13 01:57:24 (20490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 01:58:12 (20499) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:00:35 (20562) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/13 02:00:35 (20562) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/13 02:00:35 (20562) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624415879.529000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624415881.531483
2015/05/13 02:04:35 (20633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:04:48 (20645) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:04:51 (20654) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:05:36 (20665) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/13 02:05:36 (20665) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/13 02:05:36 (20665) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305407.496850
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624305409.499291
2015/05/13 02:05:39 (20666) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:05:52 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cabb68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cabb68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c756d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c43260)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 02:06:45 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c144f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c144f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14438)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14420)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 02:07:11 (20713) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:07:33 (20727) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:07:53 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c147c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c147c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14918)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 02:10:37 (20756) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/13 02:10:37 (20756) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/13 02:10:37 (20756) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635125822.767367
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6033 - canceling
bwctl: stop_endpoint: 3635125822.767367
2015/05/13 02:14:08 (20778) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:14:28 (20810) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:14:43 (20819) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:15:38 (20830) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/13 02:15:38 (20830) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/13 02:15:38 (20830) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624496975.605896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624496977.608052
2015/05/13 02:16:38 (20835) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:17:38 (20845) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:20:39 (20858) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/13 02:20:39 (20858) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/13 02:20:39 (20858) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635126402.783957
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6048 - canceling
bwctl: stop_endpoint: 3635126402.783957
2015/05/13 02:23:58 (20917) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:24:14 (20970) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:24:28 (20976) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:25:40 (20990) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/13 02:25:40 (20990) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/13 02:25:40 (20990) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770015.566681
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6007 - canceling
bwctl: stop_endpoint: 3633770017.569185
2015/05/13 02:26:32 (20995) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:27:05 (21004) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:30:41 (21079) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/13 02:30:41 (21079) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/13 02:30:41 (21079) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416269.182741
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624416271.185233
2015/05/13 02:32:41 (21086) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:33:22 (21106) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:33:59 (21130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:34:22 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c839a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c839a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c629a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5be02e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 02:34:40 (21163) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:35:42 (21173) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/13 02:35:42 (21173) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/13 02:35:42 (21173) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633770491.029948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6004 - canceling
bwctl: stop_endpoint: 3633770493.032426
2015/05/13 02:36:28 (21181) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:36:41 (21190) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:37:36 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x303f430)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x303f430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bf1898)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c148e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 02:39:07 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13e20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13e20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bda640)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5bdfe90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 02:40:43 (21243) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/13 02:40:43 (21243) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/13 02:40:43 (21243) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633770636.352451
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633770638.354643
2015/05/13 02:43:18 (21265) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:43:57 (21274) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:44:50 (21305) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:45:44 (21315) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/13 02:45:44 (21315) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/13 02:45:44 (21315) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624497279.301747
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3624497281.304233
2015/05/13 02:46:41 (21320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:47:15 (21330) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:50:45 (21343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/13 02:50:45 (21343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/13 02:50:45 (21343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635128183.459826
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635128183.459826
2015/05/13 02:53:40 (21402) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:53:51 (21414) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:53:59 (21423) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:55:46 (21475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 02:55:47 (21481) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/13 02:55:47 (21481) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/13 02:55:47 (21481) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633771119.139946
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3633771121.142428
2015/05/13 02:57:04 (21490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:00:48 (21554) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/13 03:00:48 (21554) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/13 03:00:48 (21554) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633771143.372057
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3633771145.374535
2015/05/13 03:01:26 (21581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:02:54 (21633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:03:31 (21646) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:04:01 (21655) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:05:07 (21668) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:05:49 (21676) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/13 03:05:49 (21676) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/13 03:05:49 (21676) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635128998.016330
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3635128998.016330
2015/05/13 03:06:40 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c478b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c478b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c70d28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c13890)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 03:06:52 (21686) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:08:33 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14420)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14420)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c146d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14ba0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 03:09:26 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c146d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c146d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bda700)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14c78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 03:10:50 (21739) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/13 03:10:50 (21739) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/13 03:10:50 (21739) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624497538.959654
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624497540.962163
2015/05/13 03:12:47 (21745) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:13:21 (21775) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:13:27 (21784) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:15:48 (21830) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:15:51 (21836) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/13 03:15:51 (21836) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/13 03:15:51 (21836) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129329.188238
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6047 - canceling
bwctl: stop_endpoint: 3635129329.188238
2015/05/13 03:16:45 (21841) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:20:52 (21855) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/13 03:20:52 (21855) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/13 03:20:52 (21855) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367022.570918
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624367024.573403
2015/05/13 03:21:53 (21860) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:23:32 (21886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:24:19 (21919) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:25:53 (21967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/13 03:25:53 (21967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/13 03:25:53 (21967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633771921.510669
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6045 - canceling
bwctl: stop_endpoint: 3633771923.513182
2015/05/13 03:26:42 (21991) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:26:47 (21997) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:30:54 (22015) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/13 03:30:54 (22015) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/13 03:30:54 (22015) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635129965.529326
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6028 - canceling
bwctl: stop_endpoint: 3635129965.529326
2015/05/13 03:32:00 (22020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:34:08 (22070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:34:12 (22079) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:34:19 (22096) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:35:21 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14ab0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14ab0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c149f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14cd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 03:35:35 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c43560)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c43560)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c32210)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc78f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 03:35:55 (22111) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/13 03:35:55 (22111) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/13 03:35:55 (22111) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624498081.306753
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624498083.309243
2015/05/13 03:36:11 (22115) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:36:27 (22125) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:38:19 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c148a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c148a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c147b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c13f40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 03:40:56 (23086) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/13 03:40:56 (23086) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/13 03:40:56 (23086) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633772332.334815
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3633772334.335917
2015/05/13 03:42:30 (23092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:44:17 (23134) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:44:31 (23147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:45:24 (23161) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:45:50 (23170) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:45:57 (23176) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/13 03:45:57 (23176) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/13 03:45:57 (23176) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635130759.906388
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635130759.906388
2015/05/13 03:50:58 (23186) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/13 03:50:58 (23186) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/13 03:50:58 (23186) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633772567.858382
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3633772569.860867
2015/05/13 03:53:24 (23193) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:54:18 (23234) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:55:22 (23252) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:55:59 (23278) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/13 03:55:59 (23278) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/13 03:55:59 (23278) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635131134.186323
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6021 - canceling
bwctl: stop_endpoint: 3635131134.186323
2015/05/13 03:56:13 (23282) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 03:56:20 (23295) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:01:00 (23396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/13 04:01:00 (23396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/13 04:01:00 (23396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624320425.863010
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624320427.865487
2015/05/13 04:03:39 (23420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:04:07 (23461) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:04:57 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5349608)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5349608)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c143a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14b10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 04:05:05 (23480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:05:20 (23493) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:05:45 (23500) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:05:59 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc7c20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc7c20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc6f60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c3df98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 04:06:01 (23521) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:06:02 (23527) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/13 04:06:02 (23527) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/13 04:06:02 (23527) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633773007.820674
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633773009.823153
2015/05/13 04:06:34 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14990)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14990)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13f70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c0de30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 04:11:03 (23577) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/13 04:11:03 (23577) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/13 04:11:03 (23577) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635131991.282207
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6016 - canceling
bwctl: stop_endpoint: 3635131991.282207
2015/05/13 04:14:26 (23609) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:14:32 (23633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:15:21 (23649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:15:22 (23655) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:15:25 (23661) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:16:04 (23670) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/13 04:16:04 (23670) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/13 04:16:04 (23670) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624416888.714406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6028 - canceling
bwctl: stop_endpoint: 3624416890.716928
2015/05/13 04:21:05 (23680) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/13 04:21:05 (23680) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/13 04:21:05 (23680) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635132370.532279
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6049 - canceling
bwctl: stop_endpoint: 3635132370.532279
2015/05/13 04:23:24 (23704) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:24:17 (23719) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:24:24 (23741) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:25:41 (23758) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:25:43 (23764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:26:06 (23770) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/13 04:26:06 (23770) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/13 04:26:06 (23770) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624367573.086819
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624367575.088590
2015/05/13 04:31:07 (23840) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/13 04:31:07 (23840) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/13 04:31:07 (23840) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633773800.133407
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6029 - canceling
bwctl: stop_endpoint: 3633773802.135908
2015/05/13 04:32:26 (23863) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:32:34 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14c48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14c48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c145e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 04:33:28 (23878) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:34:05 (23890) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:35:06 (23919) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:35:14 (23926) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:36:08 (23933) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/13 04:36:08 (23933) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/13 04:36:08 (23933) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635133187.727603
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3635133187.727603
2015/05/13 04:37:00 (23939) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:37:36 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c3d9c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c3d9c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc1830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c3d890)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 04:39:25 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5be0238)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5be0238)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14a98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 04:41:09 (24005) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/13 04:41:09 (24005) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/13 04:41:09 (24005) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624499034.290283
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6009 - canceling
bwctl: stop_endpoint: 3624499036.292756
2015/05/13 04:42:58 (24028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:43:26 (24041) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:44:17 (24056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:44:27 (24063) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:44:53 (24087) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:46:11 (24095) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/13 04:46:11 (24095) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/13 04:46:11 (24095) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633774181.456170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6032 - canceling
bwctl: stop_endpoint: 3633774183.456733
2015/05/13 04:51:12 (24105) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/13 04:51:12 (24105) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/13 04:51:12 (24105) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624337971.446035
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624337973.448513
2015/05/13 04:53:48 (24132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:53:49 (24141) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:54:15 (24168) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:54:48 (24178) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:55:22 (24189) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 04:56:13 (24195) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/13 04:56:13 (24195) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/13 04:56:13 (24195) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635134329.502005
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635134329.502005
2015/05/13 05:01:14 (24332) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/13 05:01:14 (24332) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/13 05:01:14 (24332) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624338026.295742
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624338028.298232
2015/05/13 05:03:00 (24338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:04:02 (24367) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:04:19 (24409) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:04:26 (24419) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:04:27 (24428) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:04:38 (24435) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:05:12 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x47adae0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x47adae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14768)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14a20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 05:06:15 (24444) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/13 05:06:15 (24444) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/13 05:06:15 (24444) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624417899.979470
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624417901.981947
2015/05/13 05:09:27 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c66b78)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c66b78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c9e828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c53c98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 05:09:53 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a590)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c13fa0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 05:11:16 (24496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/13 05:11:16 (24496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/13 05:11:16 (24496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624500021.486077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624500023.488586
2015/05/13 05:13:22 (24502) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:14:08 (24530) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:14:36 (24542) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:14:56 (24572) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:15:02 (24581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:16:17 (24588) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/13 05:16:17 (24588) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/13 05:16:17 (24588) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635135394.532806
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6020 - canceling
bwctl: stop_endpoint: 3635135394.532806
2015/05/13 05:21:18 (24598) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/13 05:21:18 (24598) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/13 05:21:18 (24598) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635135466.449585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635135466.449585
2015/05/13 05:23:33 (24620) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:24:09 (24632) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:24:14 (24642) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:24:40 (24669) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:25:13 (24681) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:26:19 (24688) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/13 05:26:19 (24688) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/13 05:26:19 (24688) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418158.045296
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624418160.047781
2015/05/13 05:31:20 (24754) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/13 05:31:20 (24754) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/13 05:31:20 (24754) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633775877.671977
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6033 - canceling
bwctl: stop_endpoint: 3633775879.674481
2015/05/13 05:33:24 (24768) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:33:34 (24792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:33:43 (24798) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:34:56 (24812) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:35:14 (24840) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:35:15 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13eb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13eb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c143a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c1a5a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 05:36:21 (24850) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/13 05:36:21 (24850) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/13 05:36:21 (24850) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635136095.851000
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3635136095.851000
2015/05/13 05:37:09 (24856) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:40:45 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a488)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a488)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14b58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c1a308)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 05:40:52 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c5b9b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c5b9b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c7b430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c9e390)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 05:41:22 (24922) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/13 05:41:22 (24922) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/13 05:41:22 (24922) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624301516.931870
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3624301518.934387
2015/05/13 05:42:35 (24943) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:43:55 (24953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:44:22 (24982) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:44:35 (24993) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:45:52 (25006) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:46:23 (25012) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/13 05:46:23 (25012) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/13 05:46:23 (25012) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635136602.451746
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6025 - canceling
bwctl: stop_endpoint: 3635136602.451746
2015/05/13 05:51:24 (25022) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/13 05:51:24 (25022) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/13 05:51:24 (25022) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624500880.594025
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624500882.596510
2015/05/13 05:52:58 (25028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:54:23 (25053) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:54:44 (25064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:55:23 (25093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 05:56:25 (25104) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/13 05:56:25 (25104) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/13 05:56:25 (25104) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633776686.702904
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6062 - canceling
bwctl: stop_endpoint: 3633776688.705399
2015/05/13 05:56:40 (25108) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:01:26 (25228) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/13 06:01:26 (25228) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/13 06:01:26 (25228) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624368610.868151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624368612.870646
2015/05/13 06:02:24 (25250) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:04:27 (25299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:04:51 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a548)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a548)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c0eb50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 06:05:11 (25313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:05:37 (25323) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:06:27 (25333) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/13 06:06:27 (25333) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/13 06:06:27 (25333) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633777282.921922
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6019 - canceling
bwctl: stop_endpoint: 3633777284.922609
2015/05/13 06:07:17 (25341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:07:33 (25348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:09:51 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c54c58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c54c58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c58b70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c62930)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 06:11:29 (25412) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/13 06:11:29 (25412) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/13 06:11:29 (25412) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624501434.355157
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624501436.357626
2015/05/13 06:11:41 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c145e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c0e8c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 06:13:14 (25420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:13:57 (25447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:14:40 (25479) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:15:18 (25491) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:16:30 (25529) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/13 06:16:30 (25529) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/13 06:16:30 (25529) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633777805.191685
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6028 - canceling
bwctl: stop_endpoint: 3633777807.194164
2015/05/13 06:18:12 (25534) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:21:31 (25548) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/13 06:21:31 (25548) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/13 06:21:31 (25548) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624418768.691180
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6063 - canceling
bwctl: stop_endpoint: 3624418770.693671
2015/05/13 06:23:30 (25555) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:23:52 (25564) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:24:12 (25593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:25:03 (25621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:26:32 (25629) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/13 06:26:32 (25629) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/13 06:26:32 (25629) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635138966.745954
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6059 - canceling
bwctl: stop_endpoint: 3635138966.745954
2015/05/13 06:28:16 (25634) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:31:33 (25717) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/13 06:31:33 (25717) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/13 06:31:33 (25717) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624501885.782561
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6018 - canceling
bwctl: stop_endpoint: 3624501887.785048
2015/05/13 06:34:18 (25783) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:34:21 (25789) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:34:38 (25819) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:34:51 (25831) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:35:17 (25841) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:36:15 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14240)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14240)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14ab0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14a68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 06:36:34 (25876) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/13 06:36:34 (25876) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/13 06:36:34 (25876) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624501998.222438
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3624502000.224927
2015/05/13 06:38:19 (25886) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:40:57 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cabec8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cabec8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c43080)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c5f080)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 06:41:35 (25936) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/13 06:41:35 (25936) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/13 06:41:35 (25936) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624502082.668100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6050 - canceling
bwctl: stop_endpoint: 3624502084.670585
2015/05/13 06:42:57 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a620)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a620)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13ef8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c147f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 06:44:19 (25947) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:44:29 (25954) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:44:58 (25980) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:45:24 (25992) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:46:36 (26018) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/13 06:46:36 (26018) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/13 06:46:36 (26018) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624338596.061526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624338598.063519
2015/05/13 06:48:43 (26061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:51:37 (26073) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/13 06:51:37 (26073) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/13 06:51:37 (26073) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635140176.417857
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6022 - canceling
bwctl: stop_endpoint: 3635140176.417857
2015/05/13 06:54:01 (26096) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:54:30 (26109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:55:03 (26121) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:55:17 (26127) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 06:56:38 (26153) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/13 06:56:38 (26153) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/13 06:56:38 (26153) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633779586.875214
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3633779588.877691
2015/05/13 06:58:01 (26158) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:01:39 (26240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/13 07:01:39 (26240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/13 07:01:39 (26240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624502468.461702
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6050 - canceling
bwctl: stop_endpoint: 3624502470.464184
2015/05/13 07:03:54 (26307) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:03:57 (26316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:04:23 (26350) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:04:24 (26356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:05:25 (26377) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:06:40 (26400) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/13 07:06:40 (26400) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/13 07:06:40 (26400) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635140889.654400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6047 - canceling
bwctl: stop_endpoint: 3635140889.654400
2015/05/13 07:07:46 (26405) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:09:08 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c99a98)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c99a98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c6cbd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c8e380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 07:09:35 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bda790)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c146d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 07:11:41 (26462) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/13 07:11:41 (26462) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/13 07:11:41 (26462) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624502591.009744
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6028 - canceling
bwctl: stop_endpoint: 3624502593.012223
2015/05/13 07:12:02 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bda790)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bda790)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c149f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c19dc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 07:13:29 (26487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:14:31 (26503) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:15:02 (26512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:15:28 (26524) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:16:42 (26547) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/13 07:16:42 (26547) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/13 07:16:42 (26547) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633780364.165210
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6057 - canceling
bwctl: stop_endpoint: 3633780366.167687
2015/05/13 07:17:32 (26552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:21:43 (26567) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/13 07:21:43 (26567) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/13 07:21:43 (26567) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624338604.449994
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624338606.452472
2015/05/13 07:24:13 (26593) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:24:25 (26605) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:24:29 (26614) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:25:24 (26624) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:26:44 (26667) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/13 07:26:44 (26667) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/13 07:26:44 (26667) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635142026.570183
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6019 - canceling
bwctl: stop_endpoint: 3635142026.570183
2015/05/13 07:27:05 (26671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:31:45 (26687) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/13 07:31:45 (26687) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/13 07:31:45 (26687) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633780744.137424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3633780746.140352
2015/05/13 07:34:04 (26713) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:34:15 (26742) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:34:28 (26754) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:35:49 (26802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:36:14 (26821) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:36:38 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c145b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c145b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13f40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c146c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 07:36:46 (26849) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/13 07:36:46 (26849) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/13 07:36:46 (26849) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633780791.440549
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3633780793.441571
2015/05/13 07:37:21 (26853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:38:50 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5ca64a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5ca64a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c75630)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c94ed8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 07:41:19 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a308)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a308)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a4d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c1a530)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 07:41:48 (26910) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/13 07:41:48 (26910) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/13 07:41:48 (26910) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635142727.684049
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635142727.684049
2015/05/13 07:43:49 (26933) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:44:20 (26945) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:44:44 (26955) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:46:09 (26968) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:46:49 (26990) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/13 07:46:49 (26990) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/13 07:46:49 (26990) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624503075.287390
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624503077.288737
2015/05/13 07:47:19 (26994) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:51:50 (27010) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/13 07:51:50 (27010) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/13 07:51:50 (27010) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624311014.574538
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624311016.577033
2015/05/13 07:52:49 (27032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:53:56 (27045) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:54:27 (27058) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:56:51 (27073) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/13 07:56:51 (27073) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/13 07:56:51 (27073) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339136.942483
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624339138.944982
2015/05/13 07:57:00 (27074) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 07:57:02 (27080) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:01:52 (27178) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/13 08:01:52 (27178) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/13 08:01:52 (27178) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635143672.207716
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6056 - canceling
bwctl: stop_endpoint: 3635143672.207716
2015/05/13 08:02:27 (27199) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:04:05 (27217) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:04:12 (27239) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:04:24 (27248) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:05:13 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14b58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14b58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13f58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14450)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 08:06:14 (27326) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:06:53 (27361) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/13 08:06:53 (27361) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/13 08:06:53 (27361) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635143768.454125
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3635143768.454125
2015/05/13 08:07:20 (27379) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:09:26 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc1350)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc1350)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c6cbf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c67a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 08:11:54 (27466) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/13 08:11:54 (27466) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/13 08:11:54 (27466) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633781986.802324
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3633781988.804811
2015/05/13 08:12:54 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14060)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14060)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x303f430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14888)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 08:13:22 (27490) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:14:22 (27505) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:15:09 (27515) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:16:37 (27529) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:16:55 (27538) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/13 08:16:55 (27538) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/13 08:16:55 (27538) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624503961.276861
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624503963.279338
2015/05/13 08:17:08 (27539) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:21:56 (27570) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/13 08:21:56 (27570) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/13 08:21:56 (27570) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624369825.259240
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624369827.261723
2015/05/13 08:24:03 (27596) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:24:12 (27605) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:24:59 (27615) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:26:19 (27628) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:26:57 (27638) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/13 08:26:57 (27638) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/13 08:26:57 (27638) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504323.512309
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6022 - canceling
bwctl: stop_endpoint: 3624504325.514832
2015/05/13 08:27:05 (27639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:31:58 (27679) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/13 08:31:58 (27679) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/13 08:31:58 (27679) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635145020.348086
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635145020.348086
2015/05/13 08:31:59 (27680) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:33:39 (27701) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:34:37 (27728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:34:49 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14c30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14c30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14d68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c13e80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 08:34:55 (27742) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:36:22 (27772) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:36:59 (27785) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/13 08:36:59 (27785) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/13 08:36:59 (27785) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633783139.886074
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3633783141.887836
2015/05/13 08:37:59 (27834) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:39:59 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c74d30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c74d30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c476d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c9e888)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 08:41:03 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14d68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14d68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c149c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c1a5d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 08:42:00 (27896) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/13 08:42:00 (27896) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/13 08:42:00 (27896) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633783196.471013
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3633783198.473524
2015/05/13 08:43:27 (27903) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:44:26 (27930) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:45:47 (27944) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:47:01 (27960) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/13 08:47:01 (27960) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/13 08:47:01 (27960) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633783385.350092
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6061 - canceling
bwctl: stop_endpoint: 3633783387.351231
2015/05/13 08:47:03 (27961) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:47:07 (27967) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:52:02 (28138) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/13 08:52:02 (28138) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/13 08:52:02 (28138) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635146151.860929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6011 - canceling
bwctl: stop_endpoint: 3635146151.860929
2015/05/13 08:53:38 (28161) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:54:21 (28173) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:56:00 (28207) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:56:23 (28219) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 08:57:03 (28226) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/13 08:57:03 (28226) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/13 08:57:03 (28226) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624339157.416181
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624339159.418676
2015/05/13 08:57:35 (28231) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:02:04 (28328) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/13 09:02:04 (28328) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/13 09:02:04 (28328) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624504881.224396
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6025 - canceling
bwctl: stop_endpoint: 3624504883.226885
2015/05/13 09:02:18 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bda790)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bda790)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5be0238)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14a08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 09:03:10 (28356) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:03:26 (28372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:04:41 (28386) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:05:32 (28398) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:05:44 (28408) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:07:01 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c95760)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c95760)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c19408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c88f28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 09:07:05 (28423) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/13 09:07:05 (28423) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/13 09:07:05 (28423) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633784247.787914
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3633784249.790396
2015/05/13 09:07:08 (28424) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:09:49 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13e20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13e20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c13e38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5bdfe78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 09:12:06 (28545) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/13 09:12:06 (28545) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/13 09:12:06 (28545) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633784442.437451
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3633784444.439905
2015/05/13 09:13:46 (28570) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:15:04 (28586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:15:28 (28598) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:15:33 (28607) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:16:09 (28617) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:17:07 (28624) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/13 09:17:07 (28624) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/13 09:17:07 (28624) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635147527.252076
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3635147527.252076
2015/05/13 09:22:08 (28650) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/13 09:22:08 (28650) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/13 09:22:08 (28650) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624504981.824305
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624504983.826794
2015/05/13 09:24:10 (28673) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:25:20 (28686) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:25:53 (28696) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:26:25 (28708) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:26:57 (28718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:27:09 (28724) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/13 09:27:09 (28724) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/13 09:27:09 (28724) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635147932.778010
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635147932.778010
2015/05/13 09:32:10 (28750) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/13 09:32:10 (28750) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/13 09:32:10 (28750) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624505089.647589
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624505091.650072
2015/05/13 09:33:51 (28773) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:34:52 (28796) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:34:54 (28802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:34:56 (28811) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:34:59 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc7cb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc7cb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c99cd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5ca6e90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 09:35:12 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c0e658)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c0e658)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c140a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c19e40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 09:36:03 (28833) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:36:36 (28842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:37:11 (28864) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/13 09:37:11 (28864) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/13 09:37:11 (28864) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635148513.379961
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3635148513.379961
2015/05/13 09:40:18 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a1b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a1b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a3b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c1a110)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 09:42:12 (28971) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/13 09:42:12 (28971) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/13 09:42:12 (28971) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785048.665475
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3633785050.667962
2015/05/13 09:44:19 (28999) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:44:27 (29008) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:45:02 (29018) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:45:53 (29031) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:47:01 (29041) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:47:13 (29062) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/13 09:47:13 (29062) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/13 09:47:13 (29062) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635149014.215795
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6034 - canceling
bwctl: stop_endpoint: 3635149014.215795
2015/05/13 09:52:14 (29073) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/13 09:52:14 (29073) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/13 09:52:14 (29073) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624339205.691152
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6053 - canceling
bwctl: stop_endpoint: 3624339207.692211
2015/05/13 09:54:31 (29096) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:55:06 (29109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:55:22 (29118) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:55:52 (29131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 09:57:15 (29141) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/13 09:57:15 (29141) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/13 09:57:15 (29141) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633785464.036430
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6033 - canceling
bwctl: stop_endpoint: 3633785466.039042
2015/05/13 09:57:18 (29142) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:02:16 (29240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/13 10:02:16 (29240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/13 10:02:16 (29240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635149629.998929
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3635149629.998929
2015/05/13 10:03:15 (29246) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:04:32 (29266) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:05:07 (29352) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:05:15 (29365) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:05:29 (29371) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:05:47 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c54208)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c54208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5cc0af8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c88b98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 10:06:33 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14300)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14300)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5306560)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c140c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 10:07:17 (29389) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/13 10:07:17 (29389) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/13 10:07:17 (29389) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635149888.383991
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635149888.383991
2015/05/13 10:07:27 (29390) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:10:11 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c147c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c147c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c1a518)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14360)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 10:12:19 (29519) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/13 10:12:19 (29519) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/13 10:12:19 (29519) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633785686.024866
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6034 - canceling
bwctl: stop_endpoint: 3633785688.027362
2015/05/13 10:14:31 (29551) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:15:19 (29564) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:15:54 (29577) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:16:22 (29586) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:17:00 (29597) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:17:19 (29603) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/13 10:17:19 (29603) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/13 10:17:19 (29603) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624505506.506526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624505508.508995
2015/05/13 10:22:20 (29698) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/13 10:22:20 (29698) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/13 10:22:20 (29698) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635150538.566035
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6023 - canceling
bwctl: stop_endpoint: 3635150538.566035
2015/05/13 10:24:43 (29725) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:25:41 (29738) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:26:01 (29750) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:26:16 (29762) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:26:43 (29772) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:27:21 (29780) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/13 10:27:21 (29780) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/13 10:27:21 (29780) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624370556.514297
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624370558.516790
2015/05/13 10:32:22 (29809) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/13 10:32:22 (29809) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/13 10:32:22 (29809) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635150966.218530
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6010 - canceling
bwctl: stop_endpoint: 3635150966.218530
2015/05/13 10:34:15 (29837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:34:16 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bdf7a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5bdf7a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c19e58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14678)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 10:35:22 (29861) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:35:33 (29867) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:35:35 (29873) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:36:31 (29896) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:37:18 (29909) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:37:23 (29915) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/13 10:37:23 (29915) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/13 10:37:23 (29915) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635151085.051000
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3635151085.051000
2015/05/13 10:38:08 (19614) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c74838)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c74838)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c19cc0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c709c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0ead8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfeb40)', 'HASH(0x5c0dd40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5bf5578)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 10:38:34 (19612) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c0e940)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c0e940)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x5c14750)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c14228)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5c0e910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5bfa8b0)', 'HASH(0x53064e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5be9330)', 'handle_results', 'CODE(0x530c0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5bda508)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 10:42:24 (30033) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/13 10:42:24 (30033) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/13 10:42:24 (30033) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786288.533664
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3633786290.536146
2015/05/13 10:43:26 (30068) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:44:35 (30081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:45:01 (30091) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:47:24 (30109) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:47:25 (30118) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/13 10:47:25 (30118) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/13 10:47:25 (30118) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624311272.292898
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624311274.295382
2015/05/13 10:47:54 (30138) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:52:26 (30164) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/13 10:52:26 (30164) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/13 10:52:26 (30164) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3633786874.176480
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3633786876.178952
2015/05/13 10:52:46 (30189) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:54:03 (30202) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:55:59 (30215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:56:57 (30338) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 10:57:27 (30351) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/13 10:57:27 (30351) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/13 10:57:27 (30351) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635152042.573903
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3635152042.573903
2015/05/13 10:57:29 (30352) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:01:15 (30549) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/13 11:01:15 (30549) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/13 11:01:15 (30549) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787112.331115
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6053 - canceling
bwctl: stop_endpoint: 3633787114.333589
2015/05/13 11:01:38 (30665) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:01:41 (30678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:01:47 (30547) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x52a4a60)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x52a4a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x52d6028)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x52...', 'HASH(0x52daa40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x52d5cf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x3fd7640)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x3fd7640)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x52a86c0)', 'handle_results', 'CODE(0x49d2060)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x52a0890)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:01:50 (30710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:01:57 (30722) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:01:57 (30548) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52bbcf8)', 'HASH(0x52da778)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52bbcf8)', 'HASH(0x52da778)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52bbcf8)', 'HASH(0x52bb230)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x52...', 'HASH(0x52da5f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x52d46a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52bbcf8)', 'HASH(0x3fd76d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52bbcf8)', 'HASH(0x3fd76d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x52ace30)', 'handle_results', 'CODE(0x49d2060)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x52a0890)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:01:59 (30728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:02:12 (30547) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x52db478)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x52db478)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x52db370)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x52...', 'HASH(0x52dae60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x52d5cf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x3fd7640)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x52b8220)', 'HASH(0x3fd7640)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x52a86c0)', 'handle_results', 'CODE(0x49d2060)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x52a0890)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:03:23 (30833) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/13 11:03:23 (30833) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/13 11:03:23 (30833) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3633787314.003088
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3633787316.005713
2015/05/13 11:04:01 (30931) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/13 11:04:01 (30931) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/13 11:04:01 (30931) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624421519.201975
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624421521.204457
2015/05/13 11:04:30 (31029) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:04:32 (31033) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:04:41 (31068) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:04:53 (31103) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:05:04 (31111) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:05:32 (31133) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:05:38 (30928) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4e6b000)', 'HASH(0x4e8bfc8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4e6b000)', 'HASH(0x4e8bfc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4e6b000)', 'HASH(0x4e8bec0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4e...', 'HASH(0x4e5a758)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4e86770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4e6b000)', 'HASH(0x4e85b28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4e6b000)', 'HASH(0x4e85b28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4e5a320)', 'handle_results', 'CODE(0x4584160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4e52710)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:05:52 (31182) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/13 11:05:52 (31182) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/13 11:05:52 (31182) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3633787654.493919
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6044 - canceling
bwctl: stop_endpoint: 3633787656.496413
2015/05/13 11:06:17 (31258) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:06:43 (31348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:06:57 (31405) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:07:06 (31411) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:07:08 (31420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:07:47 (31509) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/13 11:07:47 (31509) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/13 11:07:47 (31509) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624421718.226222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6024 - canceling
bwctl: stop_endpoint: 3624421720.228731
2015/05/13 11:08:18 (31585) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:08:20 (31590) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:08:30 (31617) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:08:36 (31621) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:08:52 (31645) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:09:24 (31516) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4bb1368)', 'HASH(0x41b6d90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4bb1368)', 'HASH(0x41b6d90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4bb1368)', 'HASH(0x4bc5ba8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4b...', 'HASH(0x4bc5b18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4bc58c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4bb1368)', 'HASH(0x4bc03d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4bb1368)', 'HASH(0x4bc03d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4ba7c50)', 'handle_results', 'CODE(0x42be380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4b8c8e0)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:09:33 (31506) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4baceb0)', 'HASH(0x4bc61a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4baceb0)', 'HASH(0x4bc61a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4baceb0)', 'HASH(0x4b8cad8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4b...', 'HASH(0x4bc6178)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4bc0a30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4baceb0)', 'HASH(0x4bbfbf0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4baceb0)', 'HASH(0x4bbfbf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4b9afa8)', 'handle_results', 'CODE(0x42be380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4b8c8e0)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:10:42 (31748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:10:45 (31512) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4badc18)', 'HASH(0x4bc69b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4badc18)', 'HASH(0x4bc69b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4badc18)', 'HASH(0x4ba4c58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x42...', 'HASH(0x4b9bb60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4bc6608)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4badc18)', 'HASH(0x4bc0208)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4badc18)', 'HASH(0x4bc0208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4ba76f8)', 'handle_results', 'CODE(0x42be380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4b8c8e0)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:12:48 (31878) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/13 11:12:48 (31878) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/13 11:12:48 (31878) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624506760.879062
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624506762.881554
2015/05/13 11:17:42 (32052) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:17:49 (32088) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/13 11:17:49 (32088) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/13 11:17:49 (32088) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624506807.260999
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624506809.263485
2015/05/13 11:17:54 (32089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:18:38 (32115) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:19:00 (32128) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:19:26 (32140) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:20:25 (32240) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/13 11:20:25 (32240) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/13 11:20:25 (32240) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635154429.287851
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6055 - canceling
bwctl: stop_endpoint: 3635154429.287851
2015/05/13 11:20:41 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5c96698)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5c96698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5c966b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc8148)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:20:46 (32348) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:20:56 (32362) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:20:57 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8478)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8478)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc82e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc8250)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:21:07 (32374) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:21:19 (32243) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5cc95a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5cc95a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x4792ae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x53...', 'HASH(0x5cc94b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc90d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5cc2988)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5cc2988)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x52b9928)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:21:20 (32385) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:21:33 (32394) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:22:10 (32237) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc8c08)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc8c08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5c93a38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc8d28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc31b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc2568)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc2568)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5c9cdb0)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:22:59 (32442) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:23:04 (32237) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc9760)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc9760)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc9010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc9148)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc31b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc2568)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc2568)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5c9cdb0)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:25:25 (32454) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/13 11:25:25 (32454) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/13 11:25:25 (32454) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635154548.599627
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6032 - canceling
bwctl: stop_endpoint: 3635154548.599627
2015/05/13 11:25:52 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc82e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc82e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8778)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc7a28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:26:20 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccffa8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccffa8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc80b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5ccff48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:30:09 (32555) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:30:26 (32567) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/13 11:30:26 (32567) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/13 11:30:26 (32567) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624339755.909599
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6009 - canceling
bwctl: stop_endpoint: 3624339757.912132
2015/05/13 11:31:12 (32591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:31:24 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cb4a18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cb4a18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8880)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5ccfc78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:31:43 (32627) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:31:46 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfc78)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfc78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8610)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc86b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:31:50 (32633) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:32:16 (32642) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:35:27 (32651) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/13 11:35:27 (32651) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/13 11:35:27 (32651) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624321435.984505
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624321437.986988
2015/05/13 11:36:34 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8010)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc7d88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc7e78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:37:00 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc83e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc83e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8340)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc8880)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:40:28 (32712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/13 11:40:28 (32712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/13 11:40:28 (32712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624422350.069251
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624422352.071749
2015/05/13 11:40:38 (32721) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:40:52 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5c93a38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5c93a38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc7de8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc8778)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:40:57 (32736) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:41:19 (32750) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:41:33 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ca6c48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ca6c48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfb70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c8f538)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:41:47 (314) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:42:03 (333) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:45:29 (402) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/13 11:45:29 (402) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/13 11:45:29 (402) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635155595.437135
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6052 - canceling
bwctl: stop_endpoint: 3635155595.437135
2015/05/13 11:45:59 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc84d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc84d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8490)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc7f98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:47:21 (416) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:50:27 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cd00e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cd00e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cd0638)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:50:30 (459) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/13 11:50:30 (459) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/13 11:50:30 (459) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635155660.443558
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6012 - canceling
bwctl: stop_endpoint: 3635155660.443558
2015/05/13 11:50:33 (460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:50:52 (32243) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5cfd1c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5cfd1c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5d54d28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x53...', 'HASH(0x5cc9b88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc90d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5cc2988)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb0c08)', 'HASH(0x5cc2988)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x52b9928)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:51:01 (498) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:51:05 (504) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:51:31 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfaf8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfaf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc86e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5ce1038)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:51:38 (515) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:52:09 (528) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:52:20 (32237) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc8d40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc8d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc8d70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5c96698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc31b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc2568)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc2568)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5c9cdb0)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:53:40 (32237) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc8dd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc8dd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc9640)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5ccf948)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc31b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc2568)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5caaa68)', 'HASH(0x5cc2568)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5c9cdb0)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:54:28 (549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 11:55:17 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8808)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8808)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfc78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc86d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 11:55:31 (568) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/13 11:55:31 (568) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/13 11:55:31 (568) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635155708.077982
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3635155708.077982
2015/05/13 11:56:02 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc7e18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc7e18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfb10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5ce1110)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:00:21 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc87d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc87d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc7d88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc8010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:00:32 (655) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/13 12:00:32 (655) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/13 12:00:32 (655) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624507898.738085
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6042 - canceling
bwctl: stop_endpoint: 3624507900.740568
2015/05/13 12:00:40 (656) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:00:47 (663) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:01:01 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfc60)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfc60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfb70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cd0788)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:01:19 (718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:01:41 (730) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:02:40 (740) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:04:59 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x471fd78)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x471fd78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x254af40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cc81f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:05:33 (864) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/13 12:05:33 (864) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/13 12:05:33 (864) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624508089.452663
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624508091.455142
2015/05/13 12:06:12 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ce0f00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ce0f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc88e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5ccffd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:10:08 (915) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:10:27 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8550)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc8550)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ce10c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5ccff78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:10:34 (934) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/13 12:10:34 (934) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/13 12:10:34 (934) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624305984.288415
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6020 - canceling
bwctl: stop_endpoint: 3624305986.290910
2015/05/13 12:10:58 (964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:11:37 (32241) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfc90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ccfc90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5ce0eb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x5c...', 'HASH(0x5cd0770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5cc7a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x5cb08f0)', 'HASH(0x5cc27c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5ca70c8)', 'handle_results', 'CODE(0x53c0e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5c8f400)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:11:39 (998) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:11:45 (1011) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:13:32 (1094) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:15:09 (1250) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/13 12:15:09 (1250) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/13 12:15:09 (1250) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635156874.882075
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3635156874.882075
2015/05/13 12:15:33 (1327) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:15:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x3582ce0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x3582ce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5190)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab51d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:15:51 (1388) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:15:54 (1394) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:16:03 (1407) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:16:04 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb188)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb188)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97b58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4a83e98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:16:53 (1436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:17:08 (1233) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4adef08)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4adef08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4b0dc90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab9a98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab40e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x41ab6c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x41ab6c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x352fad0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:20:10 (1501) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/13 12:20:10 (1501) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/13 12:20:10 (1501) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624371915.917826
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624371917.920312
2015/05/13 12:20:35 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb710)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb710)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab50b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4aa4e48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:20:59 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb0b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:24:47 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb3c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb3c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb428)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:25:11 (1630) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/13 12:25:11 (1630) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/13 12:25:11 (1630) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157430.523905
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3635157430.523905
2015/05/13 12:25:30 (1649) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:25:54 (1677) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:26:28 (1694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:26:29 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb7a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb7a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97b58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab4f98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:26:42 (1700) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:29:30 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb890)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb890)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb1a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:30:12 (1880) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/13 12:30:12 (1880) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/13 12:30:12 (1880) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624321808.810020
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624321810.811567
2015/05/13 12:31:17 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb0c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb0c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab50e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb350)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:34:00 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a9aeb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a9aeb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb7e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:35:13 (1926) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/13 12:35:13 (1926) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/13 12:35:13 (1926) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635157908.876890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6035 - canceling
bwctl: stop_endpoint: 3635157908.876890
2015/05/13 12:35:53 (1955) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:36:04 (1965) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:36:10 (1986) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:36:19 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb7e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb7e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4a88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5448)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:36:43 (2040) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:39:12 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5220)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:40:14 (2153) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/13 12:40:14 (2153) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/13 12:40:14 (2153) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635157994.161093
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3635157994.161093
2015/05/13 12:41:01 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5220)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5220)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbb18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:44:10 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb5f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:44:58 (2234) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:45:15 (2241) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/13 12:45:15 (2241) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/13 12:45:15 (2241) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509036.271437
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624509038.273923
2015/05/13 12:46:23 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc50)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb110)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5328)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:46:36 (2331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:46:39 (2341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:46:41 (2350) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:47:05 (1233) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4adf2f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4adf2f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4b0dc90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab3e30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab40e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x41ab6c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x41ab6c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x352fad0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:48:41 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b80)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb2d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:49:16 (2392) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:50:16 (2414) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/13 12:50:16 (2414) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/13 12:50:16 (2414) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509246.978261
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6027 - canceling
bwctl: stop_endpoint: 3624509248.980755
2015/05/13 12:51:27 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbab8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbab8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab52b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb248)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:53:27 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcc8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb260)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb9b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:55:11 (2520) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:55:17 (2526) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/13 12:55:17 (2526) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/13 12:55:17 (2526) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635158839.977338
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6002 - canceling
bwctl: stop_endpoint: 3635158839.977338
2015/05/13 12:56:24 (2538) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:56:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5118)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5118)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab51a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 12:56:46 (2570) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:57:30 (2589) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 12:58:10 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb890)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb890)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbaa0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb458)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:00:18 (2651) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/13 13:00:18 (2651) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/13 13:00:18 (2651) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624509320.888505
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6038 - canceling
bwctl: stop_endpoint: 3624509322.890986
2015/05/13 13:01:33 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb6e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb6e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abba40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb488)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:03:23 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4a88)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4a88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb560)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb0f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:05:00 (2702) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:05:19 (2712) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/13 13:05:19 (2712) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/13 13:05:19 (2712) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635159381.988332
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6030 - canceling
bwctl: stop_endpoint: 3635159381.988332
2015/05/13 13:06:07 (2734) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:06:39 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83448)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5148)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:07:20 (2753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:07:31 (2763) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:08:07 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb2d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb2d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb260)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:10:20 (2789) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/13 13:10:20 (2789) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/13 13:10:20 (2789) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624509600.088418
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6032 - canceling
bwctl: stop_endpoint: 3624509602.090909
2015/05/13 13:11:19 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb770)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:13:31 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb0b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:14:45 (1233) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4b373d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4b373d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4aba020)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab97f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab40e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x41ab6c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x41ab6c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x352fad0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:14:47 (2845) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:15:21 (2887) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/13 13:15:21 (2887) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/13 13:15:21 (2887) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635159776.766579
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635159776.766579
2015/05/13 13:15:29 (2889) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:15:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb1a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb1a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4e78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab4f80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:16:35 (2907) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:17:47 (2964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:18:27 (2993) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:18:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aa4e48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aa4e48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb1b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:20:22 (3019) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/13 13:20:22 (3019) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/13 13:20:22 (3019) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624509861.073247
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624509863.075746
2015/05/13 13:20:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5370)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5370)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb560)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb4b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:22:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab53b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:24:44 (3056) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:25:23 (3069) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/13 13:25:23 (3069) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/13 13:25:23 (3069) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624510156.400714
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624510158.403200
2015/05/13 13:25:25 (3070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:26:06 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4e78)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4e78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ad8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb308)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:27:23 (3104) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:27:43 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a87070)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a87070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1efc4e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb3c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:28:33 (3117) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:30:24 (3132) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/13 13:30:24 (3132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/13 13:30:24 (3132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624372459.917754
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624372461.920219
2015/05/13 13:30:43 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb320)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb320)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb668)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb248)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:32:44 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb8a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb8a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4f50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4a83e98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:34:55 (3170) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:35:25 (3199) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/13 13:35:25 (3199) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/13 13:35:25 (3199) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624510489.415119
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624510491.417604
2015/05/13 13:35:26 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4a87100)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:35:54 (3205) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:36:31 (3217) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:37:40 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb6c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb6c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abba70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:38:38 (3230) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:40:16 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a87058)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a87058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb2f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:40:26 (3252) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/13 13:40:26 (3252) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/13 13:40:26 (3252) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635161235.353390
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6008 - canceling
bwctl: stop_endpoint: 3635161235.353390
2015/05/13 13:42:24 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5430)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb728)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:44:27 (1233) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4ad1a18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4ad1a18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x4aba368)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4b02ec8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab40e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x41ab6c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa4710)', 'HASH(0x41ab6c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x352fad0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:44:57 (3325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:45:07 (3351) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:45:27 (3357) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/13 13:45:27 (3357) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/13 13:45:27 (3357) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624372753.704346
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624372755.706820
2015/05/13 13:45:51 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0940)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0940)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb920)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb758)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:46:50 (3362) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:47:28 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a87070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb5d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:49:07 (3420) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:49:49 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac08f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac08f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb7b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbb18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:50:28 (3464) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/13 13:50:28 (3464) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/13 13:50:28 (3464) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624423945.503890
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624423947.505086
2015/05/13 13:50:42 (3465) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:52:15 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0988)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0988)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abc028)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x37b6750)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:54:48 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ac0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ac0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abba28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5148)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:54:56 (3519) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:55:29 (3543) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/13 13:55:29 (3543) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/13 13:55:29 (3543) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624424075.761323
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624424077.762890
2015/05/13 13:56:04 (3548) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:56:55 (3560) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:57:34 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb290)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 13:59:28 (3580) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 13:59:56 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0928)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0928)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:00:30 (3640) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/13 14:00:30 (3640) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/13 14:00:30 (3640) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624511664.459077
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6026 - canceling
bwctl: stop_endpoint: 3624511666.461589
2015/05/13 14:02:53 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0a60)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb860)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab50d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:04:09 (3691) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:04:26 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aa10a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aa10a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5250)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb7d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:05:31 (3703) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/13 14:05:31 (3703) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/13 14:05:31 (3703) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624306038.271917
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6004 - canceling
bwctl: stop_endpoint: 3624306040.274429
2015/05/13 14:06:12 (3726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:06:12 (3727) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:07:54 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a7f968)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb3c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:08:53 (3753) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:09:28 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbce0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbc38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:10:32 (3778) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/13 14:10:32 (3778) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/13 14:10:32 (3778) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624322349.928739
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6007 - canceling
bwctl: stop_endpoint: 3624322351.929938
2015/05/13 14:13:30 (3846) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:13:33 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5088)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5088)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb188)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5148)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:13:45 (3864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:15:08 (3881) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:15:33 (3902) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/13 14:15:33 (3902) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/13 14:15:33 (3902) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312008.471394
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624312010.473208
2015/05/13 14:16:02 (3910) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:16:16 (3916) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:18:40 (3936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:18:44 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab50e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb4b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:19:37 (3976) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:20:05 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb590)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb590)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0ee0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:20:34 (4023) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/13 14:20:34 (4023) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/13 14:20:34 (4023) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635163553.154595
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3635163553.154595
2015/05/13 14:23:32 (4068) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:23:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2667200)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2667200)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4aa10a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:25:32 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1150)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1150)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1420)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0f10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:25:35 (4098) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/13 14:25:35 (4098) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/13 14:25:35 (4098) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306063.857657
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6008 - canceling
bwctl: stop_endpoint: 3624306065.860164
2015/05/13 14:25:50 (4100) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:26:40 (4115) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:28:27 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb188)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb188)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb590)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1138)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:29:48 (4129) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:30:24 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb440)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb440)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1180)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab4a88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:30:36 (4145) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/13 14:30:36 (4145) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/13 14:30:36 (4145) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374214.439273
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6027 - canceling
bwctl: stop_endpoint: 3624374216.441739
2015/05/13 14:34:00 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83e98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab51f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:34:03 (4179) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:35:13 (4193) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:35:21 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a87058)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a87058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbc08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:35:37 (4217) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/13 14:35:37 (4217) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/13 14:35:37 (4217) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624425748.245693
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624425750.248170
2015/05/13 14:35:59 (4223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:38:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb668)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb668)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb350)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:39:05 (4244) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:40:38 (4265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/13 14:40:38 (4265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/13 14:40:38 (4265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624513598.389496
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6001 - canceling
bwctl: stop_endpoint: 3624513600.391980
2015/05/13 14:40:39 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5478)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5478)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1150)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:42:18 (4302) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:43:47 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb248)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb248)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb5d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:43:58 (4354) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:45:19 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc08)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3668)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1870)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:45:35 (4388) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:45:36 (4394) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:45:39 (4400) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/13 14:45:39 (4400) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/13 14:45:39 (4400) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635164784.140685
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3635164784.140685
2015/05/13 14:48:44 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb488)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb488)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb248)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:48:52 (4412) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:49:39 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb950)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb950)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a3eae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad36b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:50:27 (4450) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:50:40 (4473) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/13 14:50:40 (4473) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/13 14:50:40 (4473) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to web100.pnw-gigapop.net  with output bwctl: start_endpoint: 3635164795.764553
bwctl: run_endpoint: receiver: 209.124.177.181
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [209.124.177.181]:6054 - canceling
bwctl: stop_endpoint: 3635164795.764553
2015/05/13 14:53:36 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb698)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1138)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:54:10 (4549) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:54:51 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac10f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac10f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0f10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:54:53 (4566) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:55:33 (4594) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:55:41 (4600) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/13 14:55:41 (4600) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/13 14:55:41 (4600) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624425789.549349
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624425791.551849
2015/05/13 14:59:01 (4614) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 14:59:02 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb338)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abba88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 14:59:26 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5160)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4a3eae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:00:42 (4676) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/13 15:00:42 (4676) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/13 15:00:42 (4676) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635165387.494873
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6012 - canceling
bwctl: stop_endpoint: 3635165387.494873
2015/05/13 15:03:39 (4724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:04:10 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b50)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbed8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4aa10a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:04:22 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac12a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac12a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1048)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1150)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:05:06 (4761) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:05:43 (4767) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/13 15:05:43 (4767) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/13 15:05:43 (4767) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624514049.123472
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6003 - canceling
bwctl: stop_endpoint: 3624514051.125963
2015/05/13 15:06:17 (4772) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:08:51 (4792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:09:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x3652cb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x3652cb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4aa4ec0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:09:17 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3770)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb6b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0d48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:10:45 (4815) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/13 15:10:45 (4815) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/13 15:10:45 (4815) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624342137.615443
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6054 - canceling
bwctl: stop_endpoint: 3624342139.617959
2015/05/13 15:13:41 (4860) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:13:53 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb878)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb878)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1348)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab4a88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:14:15 (4921) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:14:25 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3680)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3680)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1048)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x350ff58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:14:57 (4934) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:15:45 (4940) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/13 15:15:45 (4940) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/13 15:15:45 (4940) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624374543.093841
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6002 - canceling
bwctl: stop_endpoint: 3624374545.096333
2015/05/13 15:16:39 (4948) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:18:06 (4959) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:18:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3860)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3878)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:18:48 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1570)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1570)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb890)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1198)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:20:46 (4982) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/13 15:20:46 (4982) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/13 15:20:46 (4982) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624426402.362291
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624426404.362900
2015/05/13 15:21:18 (4988) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:24:03 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbfe0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbfe0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1768)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abc040)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:24:29 (5119) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:24:29 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb338)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb338)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac12e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad36b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:24:52 (5131) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:25:47 (5138) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/13 15:25:47 (5138) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/13 15:25:47 (5138) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515243.622496
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624515243.640122
2015/05/13 15:26:17 (5143) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:27:39 (5176) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:28:27 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1180)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1180)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb218)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5478)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:28:53 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f10)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0cd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:30:48 (5196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/13 15:30:48 (5196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/13 15:30:48 (5196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624515410.654068
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624515412.654900
2015/05/13 15:33:04 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1768)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1768)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac08f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb5a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:33:31 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb128)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb128)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3740)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4a83b80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:34:10 (5215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:35:07 (5290) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:35:49 (5332) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/13 15:35:49 (5332) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/13 15:35:49 (5332) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635167210.838821
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3635167210.838821
2015/05/13 15:36:04 (5337) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:36:45 (5347) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:37:36 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1498)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1498)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb218)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab51c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:38:30 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0a90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0a90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1858)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbed8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:40:50 (5373) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/13 15:40:50 (5373) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/13 15:40:50 (5373) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624374631.384818
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6014 - canceling
bwctl: stop_endpoint: 3624374633.387309
2015/05/13 15:41:21 (5379) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:42:23 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1150)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1150)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbf20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:43:46 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b80)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0ee0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:44:09 (5475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:44:57 (5512) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:45:50 (5582) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:45:51 (5591) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/13 15:45:51 (5591) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/13 15:45:51 (5591) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624515793.980262
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624515795.982758
2015/05/13 15:46:12 (5642) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:47:40 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab51f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab51f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3788)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac15a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:49:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1468)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1468)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbff8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:50:52 (5661) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/13 15:50:52 (5661) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/13 15:50:52 (5661) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516024.940267
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624516026.942739
2015/05/13 15:51:57 (5671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:52:40 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abba88)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abba88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac15e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0f10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:54:17 (5797) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:54:43 (5807) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:55:13 (5823) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:55:53 (5829) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/13 15:55:53 (5829) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/13 15:55:53 (5829) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635168310.826171
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3635168310.826171
2015/05/13 15:56:30 (5837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:56:42 (5849) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 15:58:09 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb890)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb890)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abba10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0f28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 15:59:49 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2667200)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5448)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:00:54 (5911) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/13 16:00:54 (5911) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/13 16:00:54 (5911) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624426772.863841
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624426774.864557
2015/05/13 16:03:14 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1810)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1810)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3db8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4a83448)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:04:33 (5968) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:05:02 (5997) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:05:09 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb5d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb5d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0e80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:05:55 (6009) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/13 16:05:55 (6009) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/13 16:05:55 (6009) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624516397.440406
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6037 - canceling
bwctl: stop_endpoint: 3624516399.442911
2015/05/13 16:06:04 (6011) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:06:33 (6023) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:08:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5310)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5310)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb968)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:10:02 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3848)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3848)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1420)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb578)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:10:56 (6132) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/13 16:10:56 (6132) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/13 16:10:56 (6132) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624516594.396683
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624516596.399148
2015/05/13 16:11:56 (6151) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:12:40 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:14:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb560)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb560)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbaa0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb2d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:14:54 (6242) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:15:22 (6255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:15:39 (6267) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:15:47 (6273) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:15:57 (6282) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/13 16:15:57 (6282) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/13 16:15:57 (6282) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635169493.694321
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635169493.694321
2015/05/13 16:17:36 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbea8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbea8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbc50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:19:26 (6299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:19:53 (6316) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:20:58 (6332) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/13 16:20:58 (6332) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/13 16:20:58 (6332) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624516721.236649
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624516723.239130
2015/05/13 16:22:41 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1360)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1360)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1300)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad36b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:24:24 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5370)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5370)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ab8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4a97bd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:24:28 (6427) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:24:29 (6433) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:24:46 (6447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:25:19 (6469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:25:59 (6483) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/13 16:25:59 (6483) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/13 16:25:59 (6483) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635170073.811116
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3635170073.811116
2015/05/13 16:27:54 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e08)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3cf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbe48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:28:46 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1a6b058)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1a6b058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1150)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3818)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:31:00 (6504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/13 16:31:00 (6504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/13 16:31:00 (6504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624374841.892033
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6013 - canceling
bwctl: stop_endpoint: 3624374843.894499
2015/05/13 16:33:07 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1168)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1168)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:34:07 (6558) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:34:12 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5028)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5028)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb9e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1198)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:34:26 (6567) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:35:41 (6583) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:35:53 (6589) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:36:01 (6599) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/13 16:36:01 (6599) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/13 16:36:01 (6599) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624427365.549593
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6031 - canceling
bwctl: stop_endpoint: 3624427367.552074
2015/05/13 16:37:46 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1108)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1108)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3878)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:39:12 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac15b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac15b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abba10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:40:57 (6622) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:41:02 (6639) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/13 16:41:02 (6639) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/13 16:41:02 (6639) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624517338.669717
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624517340.672200
2015/05/13 16:43:04 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0eb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0eb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab52f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:43:44 (6711) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:44:02 (6726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:44:09 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ee0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ee0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0c40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0e20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:44:52 (6745) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:46:04 (6753) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/13 16:46:04 (6753) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/13 16:46:04 (6753) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624427566.056279
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624427568.058766
2015/05/13 16:46:41 (6760) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:47:41 (6774) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:48:16 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1630)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1630)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0cd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:49:36 (6802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:51:05 (6819) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/13 16:51:05 (6819) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/13 16:51:05 (6819) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342263.810357
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624342265.812844
2015/05/13 16:53:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3cc8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3cc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad36e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0d90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:53:25 (6860) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:54:26 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1468)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1468)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1018)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad36f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:54:55 (6898) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:55:00 (6904) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:55:57 (6945) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 16:56:06 (6955) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/13 16:56:06 (6955) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/13 16:56:06 (6955) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518199.671338
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624518201.673844
2015/05/13 16:58:29 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0da8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0da8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb980)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3668)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 16:59:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad38c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5400)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:01:07 (7054) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/13 17:01:07 (7054) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/13 17:01:07 (7054) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624342294.700644
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6057 - canceling
bwctl: stop_endpoint: 3624342296.703121
2015/05/13 17:02:41 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb60)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbff8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:03:41 (7102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:04:15 (7115) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:05:00 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf98)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad36e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad39b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:05:41 (7130) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:06:04 (7140) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:06:08 (7149) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/13 17:06:08 (7149) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/13 17:06:08 (7149) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624518597.162616
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624518599.165095
2015/05/13 17:07:42 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0be0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0be0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1efc4e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0aa8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:09:34 (7162) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:10:13 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1600)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1600)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbb48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:11:09 (7204) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/13 17:11:09 (7204) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/13 17:11:09 (7204) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624518852.631482
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624518854.633960
2015/05/13 17:13:10 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1480)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1480)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac15a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:13:44 (7247) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:14:33 (7285) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:14:52 (7305) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:15:08 (7312) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:15:12 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97bd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97bd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0cd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb6b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:16:10 (7329) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/13 17:16:10 (7329) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/13 17:16:10 (7329) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624518962.514730
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624518964.516704
2015/05/13 17:16:29 (7333) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:18:22 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ba8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ba8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac11c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:19:46 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac17c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac17c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3740)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:21:11 (7364) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/13 17:21:11 (7364) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/13 17:21:11 (7364) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428210.998340
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6029 - canceling
bwctl: stop_endpoint: 3624428213.000817
2015/05/13 17:23:27 (7390) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:24:52 (7422) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:25:17 (7441) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:25:21 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abc040)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abc040)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ba8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4a8e6b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:25:54 (7451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:26:12 (7496) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/13 17:26:12 (7496) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/13 17:26:12 (7496) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624375700.041235
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6052 - canceling
bwctl: stop_endpoint: 3624375702.043732
2015/05/13 17:28:03 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1810)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1810)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3cc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1468)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:29:01 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2667200)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0f28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:31:13 (7575) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/13 17:31:13 (7575) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/13 17:31:13 (7575) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624519813.457550
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624519815.458217
2015/05/13 17:32:57 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1efc4e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1efc4e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab50d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:33:04 (7587) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:34:15 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1318)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1318)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3980)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3860)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:34:36 (7622) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:34:48 (7631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:36:14 (7647) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/13 17:36:14 (7647) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/13 17:36:14 (7647) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520049.162270
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624520051.164736
2015/05/13 17:36:48 (7651) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:37:34 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab50e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab50e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1018)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb230)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:38:31 (7668) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:38:50 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1810)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1810)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3950)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1108)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:41:15 (7722) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/13 17:41:15 (7722) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/13 17:41:15 (7722) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624520179.705873
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624520181.708506
2015/05/13 17:42:53 (7755) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:42:54 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e98)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac14b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:44:31 (7802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:44:36 (7808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:45:29 (7842) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:46:00 (7857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:46:16 (7867) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/13 17:46:16 (7867) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/13 17:46:16 (7867) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624428789.242054
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6031 - canceling
bwctl: stop_endpoint: 3624428791.244540
2015/05/13 17:47:11 (7876) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:48:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1690)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1690)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1570)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:49:29 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb698)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3980)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:51:17 (7924) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/13 17:51:17 (7924) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/13 17:51:17 (7924) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624520624.534450
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6016 - canceling
bwctl: stop_endpoint: 3624520626.536924
2015/05/13 17:52:46 (7934) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:52:50 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1888)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1888)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac15b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 17:53:58 (7948) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:55:05 (7972) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:55:48 (7987) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:56:07 (8093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 17:56:18 (8106) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/13 17:56:18 (8106) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/13 17:56:18 (8106) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624428860.247177
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624428862.249666
2015/05/13 17:57:43 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3bf0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3bf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1390)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5370)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:00:03 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:01:19 (8343) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/13 18:01:19 (8343) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/13 18:01:19 (8343) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521206.075016
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6044 - canceling
bwctl: stop_endpoint: 3624521208.077507
2015/05/13 18:02:10 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x350ff58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x2666f30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:03:23 (8357) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:03:26 (8363) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:05:03 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb740)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:06:20 (8405) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/13 18:06:20 (8405) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/13 18:06:20 (8405) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624521488.871134
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624521490.873620
2015/05/13 18:06:22 (8406) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:06:30 (8415) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:06:45 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3980)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0ee0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:10:06 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab50e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab50e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad36f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1030)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:10:55 (8461) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:11:21 (8482) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/13 18:11:21 (8482) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/13 18:11:21 (8482) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624521493.698440
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624521495.700910
2015/05/13 18:12:13 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1768)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1768)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1288)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3c98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:13:15 (8520) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:14:22 (8546) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:15:04 (8559) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:15:29 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb170)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:16:20 (8599) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:16:22 (8608) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/13 18:16:22 (8608) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/13 18:16:22 (8608) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624521765.695137
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624521767.697636
2015/05/13 18:16:55 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb170)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb170)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1480)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0eb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:17:31 (8617) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:20:35 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3680)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac09e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:21:23 (8654) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/13 18:21:23 (8654) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/13 18:21:23 (8654) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624312582.112852
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624312584.115350
2015/05/13 18:21:52 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1888)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1888)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac14c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3980)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:23:15 (8665) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:24:58 (8682) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:26:00 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1630)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1768)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:26:24 (8713) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/13 18:26:24 (8713) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/13 18:26:24 (8713) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624522081.192400
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624522083.194880
2015/05/13 18:26:36 (8714) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:27:07 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1348)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1348)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0c70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbf50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:27:19 (8729) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:30:14 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a10)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3b30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0df0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:31:25 (8826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/13 18:31:25 (8826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/13 18:31:25 (8826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635762736.141386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3635762736.141386
2015/05/13 18:32:04 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aa4ec0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad38c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:33:58 (8837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:34:52 (8850) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:35:43 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbff8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbff8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1048)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3ce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:35:52 (8883) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:36:26 (8894) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/13 18:36:26 (8894) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/13 18:36:26 (8894) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624522333.314236
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624522335.316731
2015/05/13 18:36:49 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3818)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3818)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1600)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb170)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:38:12 (8902) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:40:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0c70)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0c70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb548)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbf20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:41:09 (8942) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:41:27 (8961) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/13 18:41:27 (8961) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/13 18:41:27 (8961) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3635763315.952455
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3635763315.952455
2015/05/13 18:41:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb548)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb548)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab52c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3b30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:43:44 (8996) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:44:12 (9024) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:45:26 (9044) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:45:33 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1888)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1888)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1858)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:46:15 (9075) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:46:28 (9085) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/13 18:46:28 (9085) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/13 18:46:28 (9085) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624342892.971056
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6056 - canceling
bwctl: stop_endpoint: 3624342894.973536
2015/05/13 18:47:32 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1858)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1858)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1300)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0bc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:47:36 (9092) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:50:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ad0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1630)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1618)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:51:29 (9131) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/13 18:51:29 (9131) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/13 18:51:29 (9131) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624323479.273890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624323481.276375
2015/05/13 18:52:17 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1870)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1870)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3bd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbbf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:54:02 (9144) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:55:56 (9163) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:56:07 (9170) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:56:30 (9196) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/13 18:56:30 (9196) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/13 18:56:30 (9196) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624376611.735224
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624376613.737705
2015/05/13 18:56:39 (9221) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 18:57:07 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb728)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb728)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1678)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 18:58:32 (9240) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:00:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1858)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1858)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4a97f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:01:31 (9390) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/13 19:01:31 (9390) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/13 19:01:31 (9390) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624343426.512162
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624343428.514635
2015/05/13 19:02:22 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x22fe898)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x22fe898)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb878)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:04:37 (9410) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:05:51 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1180)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1180)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac10f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:06:18 (9427) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:06:32 (9433) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/13 19:06:32 (9433) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/13 19:06:32 (9433) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3635764630.276140
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.105
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6054 - canceling
bwctl: stop_endpoint: 3635764630.276140
2015/05/13 19:07:03 (9458) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:07:41 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb218)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb218)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1288)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb800)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:09:13 (9475) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:10:56 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb2d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb2d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3b60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb578)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:11:33 (9513) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/13 19:11:33 (9513) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/13 19:11:33 (9513) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624523584.001276
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624523586.003768
2015/05/13 19:12:12 (9526) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:12:16 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0c28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0c28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3cc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1210)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:13:33 (9568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:15:27 (9608) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:16:16 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c98)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3b78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:16:34 (9622) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/13 19:16:34 (9622) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/13 19:16:34 (9622) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624376920.202998
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6043 - canceling
bwctl: stop_endpoint: 3624376922.205474
2015/05/13 19:16:37 (9623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:17:00 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3ad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:17:48 (9652) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:18:18 (9669) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:21:35 (9709) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/13 19:21:35 (9709) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/13 19:21:35 (9709) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624523963.926594
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624523965.929075
2015/05/13 19:22:01 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb1e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:22:27 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3b00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3b00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3c98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:24:54 (9724) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:26:28 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3d58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3d58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1030)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:26:36 (9738) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/13 19:26:36 (9738) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/13 19:26:36 (9738) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524124.070198
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624524126.072671
2015/05/13 19:26:43 (9739) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:27:02 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5160)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1840)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3a10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:27:39 (9768) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:28:14 (9781) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:31:37 (9853) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/13 19:31:37 (9853) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/13 19:31:37 (9853) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624430667.320218
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624430669.322737
2015/05/13 19:31:57 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb9e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abc040)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:32:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1168)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1168)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1330)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbe18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:34:57 (9893) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:36:38 (9909) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/13 19:36:38 (9909) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/13 19:36:38 (9909) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624524462.184546
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6063 - canceling
bwctl: stop_endpoint: 3624524464.187069
2015/05/13 19:36:50 (9914) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:36:53 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1408)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:37:20 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb380)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1288)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3860)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:38:20 (9942) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:38:39 (9954) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:41:39 (9990) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/13 19:41:39 (9990) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/13 19:41:39 (9990) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624524735.186292
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6040 - canceling
bwctl: stop_endpoint: 3624524737.188539
2015/05/13 19:41:42 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb590)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb590)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:41:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb188)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb188)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5250)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0da8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:43:18 (10028) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:45:49 (10073) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:45:56 (10089) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:46:30 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1090)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:46:40 (10100) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/13 19:46:40 (10100) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/13 19:46:40 (10100) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377019.203862
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6040 - canceling
bwctl: stop_endpoint: 3624377021.206352
2015/05/13 19:47:26 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1690)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1690)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3d10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:47:37 (10105) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:48:59 (10149) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:49:27 (10162) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:51:01 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0a30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0a30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbde8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad37d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:51:34 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3680)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1030)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:51:41 (10184) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/13 19:51:41 (10184) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/13 19:51:41 (10184) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624525077.327361
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6030 - canceling
bwctl: stop_endpoint: 3624525079.329349
2015/05/13 19:56:18 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1390)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1390)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb308)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3818)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:56:42 (10210) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/13 19:56:42 (10210) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/13 19:56:42 (10210) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624525102.393756
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624525104.396235
2015/05/13 19:56:44 (10211) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:56:50 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc50)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4a97e88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 19:57:01 (10220) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:59:16 (10232) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 19:59:42 (10278) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:01:41 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3698)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab52c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:01:43 (10362) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/13 20:01:43 (10362) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/13 20:01:43 (10362) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624525284.521285
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6014 - canceling
bwctl: stop_endpoint: 3624525286.523771
2015/05/13 20:02:14 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3770)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3e00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb7a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:06:44 (10438) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/13 20:06:44 (10438) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/13 20:06:44 (10438) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624301552.177321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6041 - canceling
bwctl: stop_endpoint: 3624301554.179844
2015/05/13 20:07:16 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc50)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1528)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac18b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:07:17 (10454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:07:26 (10460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:07:42 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97f00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbda0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:09:54 (10491) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:10:07 (10504) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:11:40 (10537) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:11:46 (10555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/13 20:11:46 (10555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/13 20:11:46 (10555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624377617.119557
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624377619.122039
2015/05/13 20:11:49 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb5d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb5d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3728)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1090)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:11:57 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0be0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0be0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad36e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbf50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:13:07 (10581) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:16:40 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1a6b058)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1a6b058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab50e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5298)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:16:47 (10634) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/13 20:16:47 (10634) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/13 20:16:47 (10634) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624431824.201534
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624431826.203995
2015/05/13 20:17:13 (10641) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:17:21 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb380)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad38d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac12a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:18:23 (10651) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:19:15 (10678) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:20:33 (10712) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:21:25 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac18b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac18b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbda0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1180)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:21:48 (10724) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/13 20:21:48 (10724) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/13 20:21:48 (10724) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624526281.357541
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624526283.360023
2015/05/13 20:22:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbbf0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbbf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac11b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:26:00 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3d58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:26:49 (10748) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/13 20:26:49 (10748) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/13 20:26:49 (10748) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624324072.640122
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624324074.642593
2015/05/13 20:27:23 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b98)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0b98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb6e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:27:27 (10755) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:28:14 (10765) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:29:13 (10792) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:29:36 (10804) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:30:35 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3980)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3980)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb308)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0f40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:31:50 (10839) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/13 20:31:50 (10839) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/13 20:31:50 (10839) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324370.562790
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6063 - canceling
bwctl: stop_endpoint: 3624324372.565277
2015/05/13 20:32:30 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1588)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac13d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:35:28 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0970)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac14c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:36:51 (10920) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/13 20:36:51 (10920) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/13 20:36:51 (10920) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624344484.986636
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6019 - canceling
bwctl: stop_endpoint: 3624344486.989124
2015/05/13 20:37:40 (10927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:37:43 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3d58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3d58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbfc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0f58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:38:16 (10957) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:38:21 (10963) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:38:47 (10975) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:40:11 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ad0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb878)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1888)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:40:52 (11013) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:41:52 (11033) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/13 20:41:52 (11033) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/13 20:41:52 (11033) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624432975.278293
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624432977.280785
2015/05/13 20:42:52 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb0f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:43:49 (11066) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:45:22 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3de8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:46:53 (11108) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/13 20:46:53 (11108) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/13 20:46:53 (11108) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624344681.933882
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6024 - canceling
bwctl: stop_endpoint: 3624344683.935896
2015/05/13 20:47:22 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2666f30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2666f30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3ce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:48:06 (11118) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:48:20 (11125) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:49:03 (11151) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:49:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3d58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3d58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0a90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:49:47 (11181) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:51:54 (11203) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/13 20:51:54 (11203) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/13 20:51:54 (11203) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624433367.569606
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6036 - canceling
bwctl: stop_endpoint: 3624433369.572020
2015/05/13 20:52:35 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb560)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb560)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1240)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac13a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:55:01 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb620)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1528)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:56:55 (11228) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/13 20:56:55 (11228) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/13 20:56:55 (11228) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624379030.887877
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6129 - canceling
bwctl: stop_endpoint: 3624379032.889898
2015/05/13 20:57:11 (11232) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:57:24 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3bf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbb60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:58:52 (11245) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 20:59:36 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac14c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac14c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1360)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0970)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 20:59:36 (11278) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:00:17 (11339) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:01:56 (11384) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/13 21:01:56 (11384) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/13 21:01:56 (11384) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624379247.272448
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624379249.274960
2015/05/13 21:02:15 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac11c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:04:39 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aa4ec0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aa4ec0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1528)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:06:57 (11462) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/13 21:06:57 (11462) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/13 21:06:57 (11462) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624379367.871554
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624379369.874031
2015/05/13 21:07:41 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc50)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1240)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0e80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:08:09 (11469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:08:27 (11479) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:09:29 (11509) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:09:40 (11520) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:09:51 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0cb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abc040)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:11:58 (11555) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/13 21:11:58 (11555) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/13 21:11:58 (11555) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624344718.827492
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624344720.829974
2015/05/13 21:12:22 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1270)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0b38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:12:58 (11568) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:14:06 (11611) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:14:41 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f88)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3d58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb890)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:16:59 (11654) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/13 21:16:59 (11654) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/13 21:16:59 (11654) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624529319.645380
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624529321.647864
2015/05/13 21:17:18 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97f00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb230)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x3652cb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:18:01 (11661) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:18:28 (11671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:19:17 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3e00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5370)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:19:57 (11700) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:20:32 (11720) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:22:00 (11745) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/13 21:22:00 (11745) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/13 21:22:00 (11745) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624529365.118948
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624529367.120165
2015/05/13 21:22:34 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1840)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3c08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:24:13 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac10f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac10f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1198)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4a87058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:27:01 (11770) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/13 21:27:01 (11770) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/13 21:27:01 (11770) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624306600.903645
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6053 - canceling
bwctl: stop_endpoint: 3624306602.904689
2015/05/13 21:27:07 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad37a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3638)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:27:37 (11777) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:28:40 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad37a0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad37a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5388)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb578)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:29:00 (11809) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:29:04 (11815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:31:30 (11837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:32:02 (11861) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/13 21:32:02 (11861) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/13 21:32:02 (11861) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624529925.919545
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6051 - canceling
bwctl: stop_endpoint: 3624529927.922044
2015/05/13 21:32:33 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a70)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x26674d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:33:43 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb440)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb440)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb1b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3a40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:37:03 (11938) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/13 21:37:03 (11938) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/13 21:37:03 (11938) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624435153.835577
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624435155.838060
2015/05/13 21:37:52 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb758)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb758)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5250)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:37:53 (11949) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:38:13 (11958) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:38:39 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3698)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ab8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb620)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:39:38 (11988) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:41:29 (12027) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:41:50 (12046) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:42:04 (12055) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/13 21:42:04 (12055) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/13 21:42:04 (12055) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624435422.946932
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6012 - canceling
bwctl: stop_endpoint: 3624435424.949416
2015/05/13 21:42:53 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fa0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fa0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a3eae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0be0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:44:14 (12093) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:44:15 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1588)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1588)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2666f30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1348)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:47:05 (12130) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/13 21:47:05 (12130) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/13 21:47:05 (12130) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624345074.566641
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6036 - canceling
bwctl: stop_endpoint: 3624345076.569116
2015/05/13 21:47:47 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab51a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab51a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0bf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb6b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:48:10 (12137) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:48:25 (12147) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:49:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3968)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3968)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fa0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5310)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:49:11 (12175) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:52:07 (12209) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/13 21:52:07 (12209) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/13 21:52:07 (12209) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624531080.859801
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624531082.860655
2015/05/13 21:52:19 (12214) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:52:59 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5058)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abc040)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0c70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:54:34 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb60)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1420)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3c08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:57:07 (12242) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/13 21:57:07 (12242) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/13 21:57:07 (12242) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531193.716570
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6025 - canceling
bwctl: stop_endpoint: 3624531195.719048
2015/05/13 21:57:44 (12247) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:58:28 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac13d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 21:59:08 (12261) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:59:50 (12291) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 21:59:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1528)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1528)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3860)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0e68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:01:38 (12387) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:02:08 (12396) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/13 22:02:08 (12396) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/13 22:02:08 (12396) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624345247.270993
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6021 - canceling
bwctl: stop_endpoint: 3624345249.273474
2015/05/13 22:03:40 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac14c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3a40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:04:47 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad36f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:07:09 (12459) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/13 22:07:09 (12459) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/13 22:07:09 (12459) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624345272.604646
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624345274.607140
2015/05/13 22:08:17 (12483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:08:34 (12492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:09:32 (12513) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:10:00 (12552) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:10:03 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb758)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb758)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1420)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3b60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:10:12 (12562) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:10:45 (12575) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:12:10 (12603) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/13 22:12:10 (12603) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/13 22:12:10 (12603) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624531801.464613
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624531803.467155
2015/05/13 22:14:30 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1780)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1780)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0be0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbe90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:14:46 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3980)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3980)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb800)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:15:37 (12657) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:17:11 (12680) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/13 22:17:11 (12680) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/13 22:17:11 (12680) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624436569.695501
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6026 - canceling
bwctl: stop_endpoint: 3624436571.697983
2015/05/13 22:18:10 (12688) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:18:13 (12694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:19:39 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3b18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3b18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0e08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:20:12 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1888)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1888)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:20:13 (12733) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:21:24 (12762) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:22:12 (12774) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/13 22:22:12 (12774) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/13 22:22:12 (12774) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624436625.327321
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624436627.329808
2015/05/13 22:25:05 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5250)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5250)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:25:16 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb1e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb1e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3728)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:27:13 (12794) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/13 22:27:13 (12794) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/13 22:27:13 (12794) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624532490.221628
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6022 - canceling
bwctl: stop_endpoint: 3624532492.224123
2015/05/13 22:27:56 (12802) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:28:06 (12808) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:29:34 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1588)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb5a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:29:39 (12856) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:31:21 (12876) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:32:14 (12885) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/13 22:32:14 (12885) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/13 22:32:14 (12885) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624380888.629897
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6049 - canceling
bwctl: stop_endpoint: 3624380890.632375
2015/05/13 22:34:46 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1ee4430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb6e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:34:53 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1108)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1108)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3bd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:37:14 (12919) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:37:15 (12925) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/13 22:37:15 (12925) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/13 22:37:15 (12925) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624532817.666251
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624532819.667603
2015/05/13 22:37:17 (12926) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:37:26 (12936) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:39:41 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1828)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3788)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abba28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:39:46 (13029) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:40:17 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3998)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1228)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:40:27 (13067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:42:16 (13084) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/13 22:42:16 (13084) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/13 22:42:16 (13084) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437223.345204
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6010 - canceling
bwctl: stop_endpoint: 3624437225.347696
2015/05/13 22:42:35 (13086) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:45:20 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0be0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0be0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3710)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:45:30 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb6e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5400)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:46:29 (13156) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:47:17 (13166) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:47:18 (13175) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/13 22:47:18 (13175) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/13 22:47:18 (13175) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624533146.301304
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6001 - canceling
bwctl: stop_endpoint: 3624533148.302504
2015/05/13 22:49:21 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb350)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb350)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5250)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:50:02 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1150)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x350ff58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:50:23 (13226) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:50:24 (13235) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:52:19 (13249) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/13 22:52:19 (13249) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/13 22:52:19 (13249) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624533438.110922
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6029 - canceling
bwctl: stop_endpoint: 3624533440.113431
2015/05/13 22:53:51 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a87058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab52c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:54:39 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbcf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0df0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad39b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:56:25 (13270) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:56:51 (13286) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 22:57:20 (13294) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/13 22:57:20 (13294) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/13 22:57:20 (13294) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624533670.447874
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624533672.448844
2015/05/13 22:58:59 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c50)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0d90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 22:59:09 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5310)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5310)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac15e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:01:17 (13408) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:01:19 (13417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:02:21 (13431) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/13 23:02:21 (13431) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/13 23:02:21 (13431) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624324964.592842
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6025 - canceling
bwctl: stop_endpoint: 3624324966.595319
2015/05/13 23:04:07 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4f98)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4f98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbce0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0da8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:04:31 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac18b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac18b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbb48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:05:57 (13449) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:07:22 (13458) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/13 23:07:22 (13458) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/13 23:07:22 (13458) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534036.640057
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6055 - canceling
bwctl: stop_endpoint: 3624534038.641470
2015/05/13 23:07:47 (13468) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:09:07 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1660)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1660)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad36e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x1ee4430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:09:55 (13525) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:09:59 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb5a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb5a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3788)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb1e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:11:49 (13610) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:11:50 (13619) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:12:23 (13629) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/13 23:12:23 (13629) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/13 23:12:23 (13629) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624437736.954100
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624437738.955423
2015/05/13 23:14:19 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3728)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:14:38 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x26674d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x26674d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac14c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3cb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:15:13 (13671) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:16:48 (13707) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:17:21 (13718) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:17:24 (13724) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/13 23:17:24 (13724) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/13 23:17:24 (13724) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624437811.411453
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624437813.413934
2015/05/13 23:19:16 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbe18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3b18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:19:43 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbc38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbea8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:22:25 (13756) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/13 23:22:25 (13756) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/13 23:22:25 (13756) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624534668.354941
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624534670.355759
2015/05/13 23:22:41 (13780) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:22:47 (13789) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:23:56 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1a6b058)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x1a6b058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3e00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3698)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:24:24 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbad0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3a40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad36e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:26:46 (13828) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:27:26 (13847) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/13 23:27:26 (13847) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/13 23:27:26 (13847) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624534914.201635
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624534916.204107
2015/05/13 23:27:28 (13848) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:28:39 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb860)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb860)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1258)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb950)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:29:12 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0e80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac11b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:32:21 (13899) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:32:27 (13908) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/13 23:32:27 (13908) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/13 23:32:27 (13908) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535212.432207
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6017 - canceling
bwctl: stop_endpoint: 3624535214.434683
2015/05/13 23:33:44 (13930) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:34:04 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac17c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac17c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4a87058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:34:30 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1600)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1600)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb6e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1390)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:36:31 (13953) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:37:29 (13963) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/13 23:37:29 (13963) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/13 23:37:29 (13963) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624438086.697526
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6018 - canceling
bwctl: stop_endpoint: 3624438088.700009
2015/05/13 23:37:44 (13964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:39:10 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb950)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb950)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbd10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbb18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:39:37 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab52c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:42:08 (14068) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:42:18 (14081) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:42:29 (14098) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/13 23:42:29 (14098) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/13 23:42:29 (14098) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624535523.851885
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624535525.854379
2015/05/13 23:43:28 (14127) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:44:21 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0f28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3cb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3e00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:44:53 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97e88)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a97e88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac16c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:46:34 (14177) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:47:30 (14190) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/13 23:47:30 (14190) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/13 23:47:30 (14190) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624535575.266254
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624535577.268732
2015/05/13 23:47:30 (14191) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:48:31 (14214) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:49:02 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5208)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1840)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab5388)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:50:04 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0d30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb758)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x22fe898)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:51:19 (14248) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:52:31 (14265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/13 23:52:31 (14265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/13 23:52:31 (14265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624535849.528212
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624535851.530704
2015/05/13 23:53:15 (14295) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:53:35 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5310)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5310)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb578)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:55:08 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2666f30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x2666f30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3bf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb128)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:56:44 (14320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:57:32 (14338) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/13 23:57:32 (14338) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/13 23:57:32 (14338) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624306710.059217
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624306712.061710
2015/05/13 23:57:58 (14342) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/13 23:58:50 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1618)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac17c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/13 23:59:52 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac13c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb7b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:01:32 (14443) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:02:33 (14463) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/14 00:02:33 (14463) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/14 00:02:33 (14463) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624438393.577888
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6051 - canceling
bwctl: stop_endpoint: 3624438395.580375
2015/05/14 00:02:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb758)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb758)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1438)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0fe8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:03:37 (14487) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:04:25 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbda0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbda0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbf50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0c28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:07:27 (14510) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:07:34 (14521) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/14 00:07:34 (14521) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/14 00:07:34 (14521) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624536473.616786
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6047 - canceling
bwctl: stop_endpoint: 3624536475.617543
2015/05/14 00:07:47 (14543) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:08:26 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0c28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0c28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abba10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3ae8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:09:27 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5028)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5028)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbfc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbc20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:12:28 (14693) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:12:35 (14702) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/14 00:12:35 (14702) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/14 00:12:35 (14702) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624381535.625639
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624381537.628101
2015/05/14 00:12:45 (14710) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:13:43 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ca0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb350)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1258)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:14:06 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb1e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb1e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fe8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab5388)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:14:32 (14775) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:16:55 (14809) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:16:57 (14815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:17:36 (14826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/14 00:17:36 (14826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/14 00:17:36 (14826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624381642.619306
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6008 - canceling
bwctl: stop_endpoint: 3624381644.621794
2015/05/14 00:18:01 (14827) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:19:10 (14853) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:19:30 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5208)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb5a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abbb48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:22:37 (14888) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/14 00:22:37 (14888) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/14 00:22:37 (14888) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624439006.376366
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6015 - canceling
bwctl: stop_endpoint: 3624439008.378880
2015/05/14 00:23:17 (14892) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:24:12 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abb6e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:24:27 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4a83b38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb380)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac0970)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:25:23 (14927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:27:11 (14950) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:27:38 (14963) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/14 00:27:38 (14963) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/14 00:27:38 (14963) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624537444.428859
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624537446.431353
2015/05/14 00:27:39 (14964) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:29:23 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0970)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0970)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abba88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ad3998)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:29:32 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac11b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb098)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:32:39 (15008) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/14 00:32:39 (15008) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/14 00:32:39 (15008) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624537689.650441
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6060 - canceling
bwctl: stop_endpoint: 3624537691.652935
2015/05/14 00:33:30 (15013) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:34:27 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbda0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbda0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0fb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ab4a88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:34:53 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4abb6e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:35:15 (15048) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:36:40 (15063) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:37:19 (15072) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:37:40 (15082) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/14 00:37:40 (15082) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/14 00:37:40 (15082) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624381737.681520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6018 - canceling
bwctl: stop_endpoint: 3624381739.684008
2015/05/14 00:39:22 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ca0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad39b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbb48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:39:32 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad37e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad37e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3638)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1210)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:41:52 (15125) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:42:41 (15162) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/14 00:42:41 (15162) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/14 00:42:41 (15162) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624325385.370914
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6033 - canceling
bwctl: stop_endpoint: 3624325387.373399
2015/05/14 00:43:22 (15185) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:44:18 (15238) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:45:16 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c50)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3c50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb878)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac1600)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:45:42 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb728)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abb728)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac0eb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:46:30 (15284) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:46:55 (15298) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:47:42 (15308) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/14 00:47:42 (15308) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/14 00:47:42 (15308) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624538462.596788
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6011 - canceling
bwctl: stop_endpoint: 3624538464.599285
2015/05/14 00:48:18 (15310) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:49:23 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac17c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac17c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3bf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4abbfe0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:50:04 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3bf0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3bf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1540)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac16c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:52:41 (15368) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:52:43 (15377) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/14 00:52:43 (15377) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/14 00:52:43 (15377) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382185.922714
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624382187.925198
2015/05/14 00:54:08 (15402) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:54:37 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4f98)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab4f98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ac1000)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ad3998)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:54:56 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad36b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad36b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4abbb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ab53d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:57:26 (15436) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:57:28 (15442) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 00:57:44 (15448) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/14 00:57:44 (15448) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/14 00:57:44 (15448) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624440178.558022
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6043 - canceling
bwctl: stop_endpoint: 3624440180.560495
2015/05/14 00:59:32 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab53d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5388)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac0fe8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 00:59:58 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5400)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5400)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ab5478)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x41...', 'HASH(0x4ac1690)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:02:45 (15557) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/14 01:02:45 (15557) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/14 01:02:45 (15557) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624382379.658848
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6046 - canceling
bwctl: stop_endpoint: 3624382381.661333
2015/05/14 01:03:04 (15561) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:04:13 (15591) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:04:57 (1230) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ad0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad3ad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4ad38a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x4a...', 'HASH(0x4ac15a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x4ab4d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x4aa08f0)', 'HASH(0x4aaabb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x4a974b0)', 'handle_results', 'CODE(0x41b1160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4a7f830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:05:24 (15666) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/14 01:05:24 (15666) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/14 01:05:24 (15666) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624440731.829408
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6129 - canceling
bwctl: stop_endpoint: 3624440733.831905
2015/05/14 01:05:40 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195bf0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195bf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195b60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x5195f08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:05:45 (15748) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:05:46 (15756) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:06:19 (15807) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:06:25 (15816) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:06:28 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c940)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c940)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c118)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519c088)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:06:32 (15836) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:09:02 (15857) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:10:25 (15885) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/14 01:10:25 (15885) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/14 01:10:25 (15885) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624539855.453425
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6037 - canceling
bwctl: stop_endpoint: 3624539857.455904
2015/05/14 01:11:58 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519cb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519cb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c8e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519c640)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:14:50 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519cb80)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519cb80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c598)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x519c370)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:15:26 (16013) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/14 01:15:26 (16013) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/14 01:15:26 (16013) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624346206.384938
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6053 - canceling
bwctl: stop_endpoint: 3624346208.387442
2015/05/14 01:15:28 (16030) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:15:28 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x3e5bd70)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x3e5bd70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c940)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519ca60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:15:33 (16036) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:16:07 (16058) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:16:26 (16071) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:19:47 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5178ab8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5178ab8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c6e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x519c3e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:20:25 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x51783b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x51783b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x3d33ae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519c1a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:20:27 (16098) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/14 01:20:27 (16098) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/14 01:20:27 (16098) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540332.483896
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6012 - canceling
bwctl: stop_endpoint: 3624540334.486391
2015/05/14 01:24:48 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c628)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c628)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519cc28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x5168c68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:24:55 (16112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:25:21 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195e00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195e00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c9b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519c520)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:25:26 (16145) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:25:28 (16167) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/14 01:25:28 (16167) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/14 01:25:28 (16167) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624540469.576918
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6005 - canceling
bwctl: stop_endpoint: 3624540471.579404
2015/05/14 01:25:29 (16168) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:25:55 (16183) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:29:44 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x51a1c00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x51a1c00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x517bdf0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x519cb98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:30:29 (16205) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/14 01:30:29 (16205) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/14 01:30:29 (16205) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441329.856327
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624441331.858821
2015/05/14 01:31:18 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c8f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c8f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519cbf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x5195d70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:34:14 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c3e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c3e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c5f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x516f5b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:35:14 (16249) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:35:15 (16255) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:35:27 (16264) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:35:30 (16281) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/14 01:35:30 (16281) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/14 01:35:30 (16281) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624540909.893037
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6030 - canceling
bwctl: stop_endpoint: 3624540911.895517
2015/05/14 01:35:33 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c5b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c5b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x51a1cd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519c598)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:35:52 (16288) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:36:46 (16313) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:38:42 (16334) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:39:23 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195a58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195a58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c568)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x519cb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:40:15 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195cc8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195cc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c700)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519cc88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:40:31 (16362) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/14 01:40:31 (16362) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/14 01:40:31 (16362) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441406.701834
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6129 - canceling
bwctl: stop_endpoint: 3624441408.704319
2015/05/14 01:44:17 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c3d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c3d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195c20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x5178ab8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:44:42 (16417) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:45:00 (16445) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:45:32 (16471) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/14 01:45:32 (16471) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/14 01:45:32 (16471) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624541265.553853
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624541267.556339
2015/05/14 01:45:33 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5178ab8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5178ab8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x3c63b50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x5164ad0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:45:34 (16480) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:47:08 (16538) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:49:16 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195dd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195dd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195ed8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x51a1978)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:50:33 (16559) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/14 01:50:33 (16559) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/14 01:50:33 (16559) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624441698.028585
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624441700.031064
2015/05/14 01:50:52 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x51a1840)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x51a1840)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c7f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519c3b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:53:57 (16585) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:54:32 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c598)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519c598)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x519cc28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x519c2f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:55:00 (16604) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:55:34 (16614) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/14 01:55:34 (16614) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/14 01:55:34 (16614) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624441920.936222
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6013 - canceling
bwctl: stop_endpoint: 3624441922.938712
2015/05/14 01:55:44 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195c98)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195c98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5164398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x51...', 'HASH(0x519c358)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 01:55:49 (16620) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:57:33 (16648) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 01:59:53 (15664) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5164398)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5164398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x5195bd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x48...', 'HASH(0x519c568)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x5195830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x51818a0)', 'HASH(0x518bb38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x5178410)', 'handle_results', 'CODE(0x4892070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x5160770)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:00:15 (16736) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/14 02:00:15 (16736) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/14 02:00:15 (16736) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624441999.461471
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624442001.463965
2015/05/14 02:00:40 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7148)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7148)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b73b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b7130)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:00:49 (16763) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:00:49 (16764) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:00:55 (16778) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:00:58 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7208)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7250)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b71d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:01:16 (16844) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:01:37 (16854) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:02:28 (16874) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:05:16 (16896) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/14 02:05:16 (16896) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/14 02:05:16 (16896) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624542185.705600
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6039 - canceling
bwctl: stop_endpoint: 3624542187.708103
2015/05/14 02:05:21 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd950)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd950)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd3b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b6a88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:05:54 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd830)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd1b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdcc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:10:02 (16929) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:10:17 (16953) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/14 02:10:17 (16953) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/14 02:10:17 (16953) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624542448.304520
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6057 - canceling
bwctl: stop_endpoint: 3624542450.307007
2015/05/14 02:10:57 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd1d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd1d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b7310)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:11:09 (16984) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:11:16 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x3154cb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x3154cb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd9b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:11:20 (16996) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:11:31 (17006) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:15:18 (17048) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/14 02:15:18 (17048) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/14 02:15:18 (17048) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624382785.389170
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624382787.391644
2015/05/14 02:15:45 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7100)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7100)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd830)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd290)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:16:17 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd770)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd770)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd920)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b73d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:20:19 (17145) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/14 02:20:19 (17145) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/14 02:20:19 (17145) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624382875.598445
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6038 - canceling
bwctl: stop_endpoint: 3624382877.600929
2015/05/14 02:20:22 (17146) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:20:23 (17155) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:21:00 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd920)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd920)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd6c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd1b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:21:07 (17200) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:21:39 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x4599450)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:21:42 (17215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:25:20 (17226) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/14 02:25:20 (17226) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/14 02:25:20 (17226) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624313671.042507
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6039 - canceling
bwctl: stop_endpoint: 3624313673.044099
2015/05/14 02:25:37 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd3c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd3c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b7208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:26:59 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd248)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd248)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd368)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x4585448)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:29:48 (17247) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:29:55 (17253) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:30:21 (17323) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/14 02:30:21 (17323) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/14 02:30:21 (17323) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624543431.765876
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6032 - canceling
bwctl: stop_endpoint: 3624543433.768383
2015/05/14 02:31:41 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45a6e48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45a6e48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4599bd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b73b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:32:08 (17371) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:32:11 (17380) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:32:14 (17386) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:33:26 (17407) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:35:22 (17430) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/14 02:35:22 (17430) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/14 02:35:22 (17430) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624543504.650165
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624543506.652635
2015/05/14 02:35:35 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd1d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd1d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7298)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd230)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:36:24 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x3cf0618)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x3cf0618)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2a48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b7070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:39:34 (17454) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:39:42 (17463) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:40:23 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd4b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd4b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x4599b58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:40:23 (17479) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/14 02:40:23 (17479) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/14 02:40:23 (17479) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624299739.495609
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624299741.498156
2015/05/14 02:41:29 (17484) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:41:43 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b6f80)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b6f80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b73e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd950)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:42:15 (17528) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:45:24 (17566) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/14 02:45:24 (17566) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/14 02:45:24 (17566) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347036.976121
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624347038.977420
2015/05/14 02:45:48 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4589070)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4589070)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd5a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bdb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:47:11 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d90)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d90)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd7d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd998)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:50:09 (17661) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:50:24 (17676) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:50:25 (17682) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/14 02:50:25 (17682) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/14 02:50:25 (17682) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544108.012343
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6014 - canceling
bwctl: stop_endpoint: 3624544110.014824
2015/05/14 02:50:33 (17684) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:51:13 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd500)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd500)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd128)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b6f50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:51:42 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4581a28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4581a28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdc98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b7010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:52:42 (17731) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 02:55:27 (17749) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/14 02:55:27 (17749) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/14 02:55:27 (17749) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544307.567230
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6010 - canceling
bwctl: stop_endpoint: 3624544309.569709
2015/05/14 02:56:15 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd230)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd230)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2c58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bdb78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 02:56:42 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd248)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd248)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd5f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd8c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:00:05 (17821) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:00:10 (17837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:00:14 (17843) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:00:25 (17852) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:00:27 (17861) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/14 03:00:27 (17861) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/14 03:00:27 (17861) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326157.761751
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6035 - canceling
bwctl: stop_endpoint: 3624326159.762385
2015/05/14 03:01:10 (17890) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:01:14 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd7e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd7e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd920)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd998)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:01:28 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2af0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b72f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:03:13 (17949) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:05:28 (17967) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/14 03:05:28 (17967) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/14 03:05:28 (17967) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624544729.484007
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624544731.486487
2015/05/14 03:05:41 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd3c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd3c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bda88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:06:00 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4589d18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4589d18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4540ae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd6c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:09:25 (18001) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:09:32 (18010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:09:41 (18020) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:10:29 (18035) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/14 03:10:29 (18035) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/14 03:10:29 (18035) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624544933.245226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6044 - canceling
bwctl: stop_endpoint: 3624544935.247705
2015/05/14 03:11:07 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2c70)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2c70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd7b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:11:35 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b6f20)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b6f20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd350)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd560)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:12:27 (18078) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:15:30 (18121) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/14 03:15:30 (18121) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/14 03:15:30 (18121) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624347616.857200
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6051 - canceling
bwctl: stop_endpoint: 3624347618.859683
2015/05/14 03:15:40 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c29d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b71a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:16:05 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd818)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd818)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2cb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b73b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:19:12 (18196) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:19:27 (18217) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:19:30 (18223) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:20:31 (18245) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/14 03:20:31 (18245) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/14 03:20:31 (18245) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624545282.028984
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6034 - canceling
bwctl: stop_endpoint: 3624545284.031476
2015/05/14 03:20:56 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4599bd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4599bd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b6d70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b6ff8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:21:23 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdcb0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd998)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdb78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:23:18 (18292) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:25:32 (18303) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/14 03:25:32 (18303) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/14 03:25:32 (18303) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624545370.224202
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6043 - canceling
bwctl: stop_endpoint: 3624545372.226677
2015/05/14 03:26:18 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd998)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd998)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45a30a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bdc80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:26:26 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd350)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd350)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2958)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bda88)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:28:15 (18319) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:28:42 (18336) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:28:49 (18345) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:28:57 (18361) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:30:00 (18372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:30:33 (18392) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/14 03:30:33 (18392) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/14 03:30:33 (18392) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624545590.103189
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6036 - canceling
bwctl: stop_endpoint: 3624545592.105678
2015/05/14 03:30:47 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7130)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7130)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdc98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c2c10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:31:42 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdcf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:32:27 (18439) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:35:34 (18728) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/14 03:35:34 (18728) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/14 03:35:34 (18728) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444138.980276
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6045 - canceling
bwctl: stop_endpoint: 3624444140.981980
2015/05/14 03:35:40 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2b38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2b38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2af0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b7130)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:36:48 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd3f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd3f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4585448)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:37:55 (18742) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:38:20 (18760) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:38:34 (18769) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:40:35 (18784) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/14 03:40:35 (18784) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/14 03:40:35 (18784) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624384548.770081
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6058 - canceling
bwctl: stop_endpoint: 3624384550.772570
2015/05/14 03:41:03 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdfe0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdfe0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd3e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b7358)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:41:26 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7358)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7358)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7460)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd230)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:41:51 (18812) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:45:36 (18864) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/14 03:45:36 (18864) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/14 03:45:36 (18864) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624546203.708587
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6016 - canceling
bwctl: stop_endpoint: 3624546205.711055
2015/05/14 03:46:00 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7058)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b6f50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:47:20 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd998)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd998)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7100)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:47:45 (18894) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:47:50 (18902) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:48:49 (18917) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:50:33 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2ca0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45be058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x4599f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:50:37 (18980) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/14 03:50:37 (18980) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/14 03:50:37 (18980) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624444709.281351
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624444711.283853
2015/05/14 03:51:05 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdf08)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdf08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4581a28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x4581ab8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:51:37 (19012) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:55:09 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd7e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd7e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd4a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x4599f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:55:38 (19048) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/14 03:55:38 (19048) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/14 03:55:38 (19048) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624384594.802969
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624384596.805449
2015/05/14 03:55:45 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdf68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdf68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd680)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c2a30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 03:57:21 (19061) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:57:33 (19070) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:58:08 (19090) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 03:58:57 (19102) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:00:30 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd458)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd458)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bda58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd368)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:00:39 (19167) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/14 04:00:39 (19167) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/14 04:00:39 (19167) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445023.875226
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6020 - canceling
bwctl: stop_endpoint: 3624445025.877702
2015/05/14 04:01:03 (19189) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:01:29 (19206) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:01:57 (19233) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:05:22 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdb18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bdc08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:05:40 (19272) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/14 04:05:40 (19272) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/14 04:05:40 (19272) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624384784.447762
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6038 - canceling
bwctl: stop_endpoint: 3624384786.450228
2015/05/14 04:06:10 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bded8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bded8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd440)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c38a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:06:37 (19280) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:07:46 (19299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:08:19 (19308) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:10:40 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7010)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:10:41 (19327) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/14 04:10:41 (19327) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/14 04:10:41 (19327) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445334.737719
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6015 - canceling
bwctl: stop_endpoint: 3624445336.740193
2015/05/14 04:11:02 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3240)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3240)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd638)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x4581968)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:12:47 (19369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:14:53 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7370)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x4599450)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:15:42 (19410) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/14 04:15:42 (19410) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/14 04:15:42 (19410) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624445616.440566
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6059 - canceling
bwctl: stop_endpoint: 3624445618.443056
2015/05/14 04:16:10 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdf08)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdf08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b7088)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:16:43 (19425) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:18:14 (19451) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:18:40 (19461) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:19:25 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd5a8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd5a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d58a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:20:43 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7250)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7250)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bddb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c2c58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:20:44 (19500) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/14 04:20:44 (19500) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/14 04:20:44 (19500) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624548065.260401
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6004 - canceling
bwctl: stop_endpoint: 3624548067.262869
2015/05/14 04:23:15 (19577) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:24:18 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd1b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd1b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdc08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x4540ae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:25:25 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x21694d0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x21694d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdc38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdd10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:25:44 (19599) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/14 04:25:44 (19599) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/14 04:25:44 (19599) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624445895.661151
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6042 - canceling
bwctl: stop_endpoint: 3624445897.663636
2015/05/14 04:25:57 (19602) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:27:47 (19623) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:27:55 (19639) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:28:21 (19648) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:29:44 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd920)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd920)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdb48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x2169098)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:30:45 (19668) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/14 04:30:45 (19668) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/14 04:30:45 (19668) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624548443.631051
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624548445.633525
2015/05/14 04:31:39 (19686) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:32:06 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2ca0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d56c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45b73e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:32:22 (19722) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:34:57 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d48)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3408)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c2bf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:35:46 (19744) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/14 04:35:46 (19744) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/14 04:35:46 (19744) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624303892.481722
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6062 - canceling
bwctl: stop_endpoint: 3624303894.484217
2015/05/14 04:35:52 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdf68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdf68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3828)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c2c10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:36:52 (19756) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:38:25 (19776) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:38:36 (19782) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:40:06 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45a6ec0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45a6ec0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd968)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c2910)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:40:47 (19797) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/14 04:40:47 (19797) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/14 04:40:47 (19797) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624385337.187147
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6041 - canceling
bwctl: stop_endpoint: 3624385339.189631
2015/05/14 04:40:56 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2169200)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2169200)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b6f80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd938)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:42:41 (19837) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:45:21 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3420)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd1e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:45:48 (19878) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/14 04:45:48 (19878) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/14 04:45:48 (19878) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624446497.691345
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6006 - canceling
bwctl: stop_endpoint: 3624446499.693838
2015/05/14 04:46:13 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7328)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7328)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2a30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c2bc8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:46:53 (19891) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:47:25 (19911) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:48:04 (19923) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:49:56 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2928)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2928)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4540ae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b70e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:50:49 (19943) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/14 04:50:49 (19943) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/14 04:50:49 (19943) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624348187.750386
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6008 - canceling
bwctl: stop_endpoint: 3624348189.751061
2015/05/14 04:51:37 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bda70)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bda70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3780)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c38a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:53:15 (20039) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:54:36 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd6e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 04:55:50 (20062) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/14 04:55:50 (20062) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/14 04:55:50 (20062) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624385672.070086
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6062 - canceling
bwctl: stop_endpoint: 3624385674.072565
2015/05/14 04:56:49 (20067) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:57:23 (20086) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:57:37 (20096) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:57:40 (20103) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:57:49 (20112) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:58:36 (20132) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 04:59:43 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3708)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3708)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd500)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd2f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:00:51 (20201) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/14 05:00:51 (20201) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/14 05:00:51 (20201) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624314325.546280
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6010 - canceling
bwctl: stop_endpoint: 3624314327.548766
2015/05/14 05:02:17 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2bf8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2bf8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4585e98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c34c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:03:42 (20263) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:04:54 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5708)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5708)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd5a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5798)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:05:52 (20287) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/14 05:05:52 (20287) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/14 05:05:52 (20287) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624550282.236718
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6003 - canceling
bwctl: stop_endpoint: 3624550284.237248
2015/05/14 05:07:07 (20299) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:07:29 (20310) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:07:49 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2cd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2cd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5ae0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c3468)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:08:29 (20325) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:09:36 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7010)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7010)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdb60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x4599f00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:10:53 (20340) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/14 05:10:53 (20340) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/14 05:10:53 (20340) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624326787.370550
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6021 - canceling
bwctl: stop_endpoint: 3624326789.373030
2015/05/14 05:12:10 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2928)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2928)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdcb0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdf20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:14:03 (20369) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:14:37 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d58b8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d58b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5db0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x4599bd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:15:54 (20412) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/14 05:15:54 (20412) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/14 05:15:54 (20412) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386311.813129
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6049 - canceling
bwctl: stop_endpoint: 3624386313.815602
2015/05/14 05:16:22 (20426) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:17:42 (20459) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:17:48 (20471) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:18:37 (20483) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:19:41 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3090)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3090)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bde78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd0f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:20:55 (20498) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/14 05:20:55 (20498) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/14 05:20:55 (20498) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624326979.105361
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6061 - canceling
bwctl: stop_endpoint: 3624326981.107842
2015/05/14 05:22:51 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2cd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2cd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2a60)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdea8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:24:20 (20600) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:24:23 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d56c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5db0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:25:25 (20619) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:25:56 (20630) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/14 05:25:56 (20630) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/14 05:25:56 (20630) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624386912.679924
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6056 - canceling
bwctl: stop_endpoint: 3624386914.681478
2015/05/14 05:26:14 (20631) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:27:06 (20651) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:27:24 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2e80)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2e80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3738)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd2c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:28:36 (20672) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:28:59 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2169638)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2169638)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4585b20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5708)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:29:02 (20694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:30:57 (20706) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/14 05:30:57 (20706) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/14 05:30:57 (20706) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624448670.086293
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6022 - canceling
bwctl: stop_endpoint: 3624448672.088785
2015/05/14 05:32:26 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd368)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd368)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3708)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c2988)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:34:05 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd908)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd908)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7088)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c38b8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:35:17 (20757) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:35:45 (20771) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:35:58 (20777) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/14 05:35:58 (20777) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/14 05:35:58 (20777) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624551896.310154
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6112 - canceling
bwctl: stop_endpoint: 3624551896.428692
2015/05/14 05:37:08 (20787) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:38:40 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5a80)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5a80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd128)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bda10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:39:09 (20813) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:39:20 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3498)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3498)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c3780)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:40:59 (20826) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/14 05:40:59 (20826) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/14 05:40:59 (20826) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624448794.145146
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6029 - canceling
bwctl: stop_endpoint: 3624448796.147604
2015/05/14 05:42:57 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c33d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c33d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd758)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45d5e40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:44:11 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3660)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3660)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c38a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c3690)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:44:28 (20872) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:46:00 (20895) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/14 05:46:00 (20895) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/14 05:46:00 (20895) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624448975.797782
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6001 - canceling
bwctl: stop_endpoint: 3624448977.800273
2015/05/14 05:46:28 (20909) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:47:11 (20927) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:47:46 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2f0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2f0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3258)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45d5948)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:48:54 (20954) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:49:25 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3588)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3588)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5d68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bded8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:51:01 (20968) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/14 05:51:01 (20968) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/14 05:51:01 (20968) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624303981.974749
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624303983.977255
2015/05/14 05:53:01 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7280)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7280)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3738)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd680)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:54:11 (21032) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:54:19 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5b70)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5b70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2169200)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd398)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:55:59 (21085) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:56:02 (21101) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/14 05:56:02 (21101) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/14 05:56:02 (21101) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624553054.263171
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6058 - canceling
bwctl: stop_endpoint: 3624553056.265643
2015/05/14 05:56:30 (21114) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:57:56 (21135) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:58:03 (21144) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:58:14 (21150) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 05:58:18 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd728)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd728)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7058)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd968)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 05:59:10 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c34c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c34c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd938)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c29d0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:01:04 (21236) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/14 06:01:04 (21236) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/14 06:01:04 (21236) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553147.636204
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624553149.638377
2015/05/14 06:02:51 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5b28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5b28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45d59c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:04:11 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7100)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5d68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:04:24 (21283) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:06:05 (21303) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/14 06:06:05 (21303) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/14 06:06:05 (21303) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624449436.585093
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6034 - canceling
bwctl: stop_endpoint: 3624449438.587624
2015/05/14 06:06:14 (21304) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:07:21 (21320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:07:42 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd2c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45d5ca8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:08:46 (21341) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:09:41 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5e28)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5e28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c34e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45a6ec0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:11:06 (21359) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/14 06:11:06 (21359) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/14 06:11:06 (21359) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624553730.671246
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6002 - canceling
bwctl: stop_endpoint: 3624553732.673719
2015/05/14 06:12:44 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd638)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd638)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c30d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c3420)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:14:10 (21400) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:14:25 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd9b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d56a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:16:07 (21436) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/14 06:16:07 (21436) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/14 06:16:07 (21436) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624327424.982337
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6049 - canceling
bwctl: stop_endpoint: 3624327426.984828
2015/05/14 06:16:19 (21447) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:16:54 (21460) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:17:50 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c34c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c34c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c36d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bda40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:19:05 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7280)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7280)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c3600)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:19:15 (21492) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:21:08 (21504) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/14 06:21:08 (21504) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/14 06:21:08 (21504) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624449879.355424
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6005 - canceling
bwctl: stop_endpoint: 3624449881.357900
2015/05/14 06:23:29 (21575) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:23:39 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d56c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d56c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x19e6430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45d5c78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:24:12 (21627) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:24:16 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3498)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3498)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7208)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c3048)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:26:09 (21680) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/14 06:26:09 (21680) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/14 06:26:09 (21680) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624387532.513992
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624387534.516500
2015/05/14 06:26:30 (21696) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:26:48 (21717) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:27:05 (21726) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:28:12 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2e68)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2e68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7268)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45a6ec0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:28:42 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0e0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd0e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c38a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b6d70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:30:03 (21815) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:31:10 (21822) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/14 06:31:10 (21822) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/14 06:31:10 (21822) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624450469.165151
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6061 - canceling
bwctl: stop_endpoint: 3624450471.167635
2015/05/14 06:32:48 (21864) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:33:51 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdb18)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdb18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5b28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c33a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:34:17 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57c8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5d08)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c32e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:36:03 (21893) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:36:11 (21902) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/14 06:36:11 (21902) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/14 06:36:11 (21902) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624554979.165680
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6044 - canceling
bwctl: stop_endpoint: 3624554981.168160
2015/05/14 06:36:17 (21903) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:38:10 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d59c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d59c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3660)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd350)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:38:41 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7280)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7280)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3288)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bd638)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:40:17 (21934) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:41:12 (21943) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/14 06:41:12 (21943) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/14 06:41:12 (21943) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624387733.342619
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6006 - canceling
bwctl: stop_endpoint: 3624387735.345097
2015/05/14 06:42:24 (22031) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:43:31 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3498)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3498)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45a6e48)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:44:02 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2169200)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2169200)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd590)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x2169098)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:45:49 (22078) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:46:13 (22088) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/14 06:46:13 (22088) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/14 06:46:13 (22088) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624555463.231260
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6023 - canceling
bwctl: stop_endpoint: 3624555465.233661
2015/05/14 06:46:52 (22106) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:48:42 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2fb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2fb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57e0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c2ca0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:49:08 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5a20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45d5d80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:50:34 (22146) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:51:14 (22153) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/14 06:51:14 (22153) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/14 06:51:14 (22153) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624555578.660890
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6050 - canceling
bwctl: stop_endpoint: 3624555580.663378
2015/05/14 06:53:00 (22176) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:53:43 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bded8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bded8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bda28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b70a0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:54:01 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d56c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d56c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5d98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x156d118)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:54:36 (22215) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:55:33 (22241) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:56:04 (22251) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:56:15 (22277) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/14 06:56:15 (22277) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/14 06:56:15 (22277) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624327615.893054
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6041 - canceling
bwctl: stop_endpoint: 3624327617.895524
2015/05/14 06:58:50 (22331) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 06:58:54 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3570)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3570)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d18)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c3558)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 06:59:14 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5e40)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5e40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd368)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c2e68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:01:01 (22419) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:01:16 (22425) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/14 07:01:16 (22425) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/14 07:01:16 (22425) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624451223.388789
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6056 - canceling
bwctl: stop_endpoint: 3624451225.391248
2015/05/14 07:03:26 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c31f8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c31f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d56c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5d80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:03:31 (22469) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:03:42 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5c00)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5c00)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57f8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x19e6430)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:05:10 (22491) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:06:17 (22509) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/14 07:06:17 (22509) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/14 07:06:17 (22509) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624307794.247687
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6020 - canceling
bwctl: stop_endpoint: 3624307796.250192
2015/05/14 07:06:29 (22510) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:08:09 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c32e8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c32e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c33d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c3090)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:08:26 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7280)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7280)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3660)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdef0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:10:26 (22570) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:11:18 (22578) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/14 07:11:18 (22578) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/14 07:11:18 (22578) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624556663.187326
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6031 - canceling
bwctl: stop_endpoint: 3624556665.189826
2015/05/14 07:12:36 (22604) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:12:52 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2988)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2988)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bda28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5d68)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:13:26 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2b50)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2b50)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d57c8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bdae8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:16:00 (22660) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:16:19 (22673) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/14 07:16:19 (22673) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/14 07:16:19 (22673) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624451638.230311
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6048 - canceling
bwctl: stop_endpoint: 3624451640.232043
2015/05/14 07:17:22 (22694) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:17:46 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5960)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5960)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3558)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d56c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:18:03 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5a38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5a38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdbd8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd8a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:21:01 (22728) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:21:20 (22734) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/14 07:21:20 (22734) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/14 07:21:20 (22734) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624315008.004452
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6047 - canceling
bwctl: stop_endpoint: 3624315010.006947
2015/05/14 07:21:49 (22756) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:22:20 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4599b58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4599b58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2c10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c3690)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:23:36 (22774) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:23:39 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5e10)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5e10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5930)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd500)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:25:34 (22818) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:26:21 (22831) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/14 07:26:21 (22831) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/14 07:26:21 (22831) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624451989.134663
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6057 - canceling
bwctl: stop_endpoint: 3624451991.137155
2015/05/14 07:27:19 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd968)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd968)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bda70)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45bdb30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:28:08 (22897) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:28:12 (22915) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:28:37 (22923) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:31:09 (22959) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:31:23 (22985) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/14 07:31:23 (22985) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/14 07:31:23 (22985) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624328361.661045
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6007 - canceling
bwctl: stop_endpoint: 3624328363.663538
2015/05/14 07:31:31 (22986) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:32:21 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2168de0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x2168de0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5960)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5a20)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:33:33 (23010) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:35:34 (23040) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:36:23 (23053) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/14 07:36:23 (23053) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/14 07:36:23 (23053) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624557909.118362
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6039 - canceling
bwctl: stop_endpoint: 3624557911.120837
2015/05/14 07:36:40 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd6b0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd6b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x4599b58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c2f10)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:37:31 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2fb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2fb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5cc0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c3120)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:38:25 (23064) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:41:16 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b71d8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b71d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3078)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b7268)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:41:24 (23176) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/14 07:41:24 (23176) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/14 07:41:24 (23176) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624300919.897808
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6009 - canceling
bwctl: stop_endpoint: 3624300921.899597
2015/05/14 07:41:34 (23177) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:41:59 (23204) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:43:13 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2cd0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2cd0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5738)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bd500)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:45:49 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bde30)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bde30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c30d8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5a98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:46:22 (23252) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:46:25 (23265) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/14 07:46:25 (23265) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/14 07:46:25 (23265) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624558491.783432
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6017 - canceling
bwctl: stop_endpoint: 3624558493.785903
2015/05/14 07:47:37 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdc38)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bdc38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5a38)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x4585e98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:47:42 (23289) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:50:37 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7100)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45b7100)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd8a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45b7370)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:51:26 (23315) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/14 07:51:26 (23315) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/14 07:51:26 (23315) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624351250.980403
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6007 - canceling
bwctl: stop_endpoint: 3624351252.982876
2015/05/14 07:51:54 (23320) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:52:32 (23330) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:52:55 (23372) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:52:59 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45a6ec0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45a6ec0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3030)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45d5e28)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:55:18 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5d80)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5d80)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2be0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x2168f30)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:55:56 (23410) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 07:56:27 (23419) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/14 07:56:27 (23419) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/14 07:56:27 (23419) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to nine.usc.edu  with output bwctl: start_endpoint: 3624328777.389235
bwctl: run_endpoint: receiver: 128.125.253.53
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [128.125.253.53]:6060 - canceling
bwctl: stop_endpoint: 3624328779.391713
2015/05/14 07:57:33 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2c58)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2c58)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c32e8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 07:57:59 (23431) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 08:00:22 (23544) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 08:00:35 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d78)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c2d78)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd6b0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45c3780)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 08:01:28 (23591) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/14 08:01:28 (23591) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/14 08:01:28 (23591) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps.sdsc.xsede.org  with output bwctl: start_endpoint: 3624559106.201332
bwctl: run_endpoint: receiver: 198.202.105.14
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.202.105.14]:6045 - canceling
bwctl: stop_endpoint: 3624559108.203812
2015/05/14 08:01:36 (23592) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 08:02:40 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd110)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd110)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c30a8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45bddb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 08:03:14 (23640) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 08:05:26 (23660) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.
2015/05/14 08:05:38 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd5c0)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd5c0)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45d5a98)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x3c...', 'HASH(0x45d5780)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 08:06:29 (23703) ERROR> EsmondBase.pm:53 perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__ - Error writing metadata (1) Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/14 08:06:29 (23703) ERROR> MeasurementArchiveChild.pm:209 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_results - Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/14 08:06:29 (23703) ERROR> MeasurementArchiveChild.pm:125 perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__ - Problem handling test results: Problem storing results: Error writing metadata: Error running test to ps-antl-meter.nren.nasa.gov  with output bwctl: start_endpoint: 3624453228.858964
bwctl: run_endpoint: receiver: 198.10.1.45
bwctl: run_endpoint: sender: 137.78.171.20
bwctl: Unable to initiate peer handshake with [198.10.1.45]:6048 - canceling
bwctl: stop_endpoint: 3624453230.861436
2015/05/14 08:07:44 (16733) ERROR> CmdRunner.pm:110 perfSONAR_PS::RegularTesting::Utils::CmdRunner::run - Problem with results callback: Attribute (tool) does not pass the type constraint because: Validation failed for 'Str' with value undef at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/Bwctl.pm line 119
	perfSONAR_PS::RegularTesting::Tests::Bwctl::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3078)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::Bwctl::build_results('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45c3078)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 237
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::handle_output('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45bd500)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 180
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Utils::CmdRunner::Cmd=HASH(0x45...', 'HASH(0x45c3198)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 108
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Utils/CmdRunner.pm line 107
	perfSONAR_PS::RegularTesting::Utils::CmdRunner::run('perfSONAR_PS::RegularTesting::Utils::CmdRunner=HASH(0x45b6d40)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Tests/BwctlBase.pm line 188
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::__ANON__('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Tests::BwctlBase::run_test('perfSONAR_PS::RegularTesting::Tests::Bwctl=HASH(0x45a28f0)', 'HASH(0x45acbb8)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Test.pm line 75
	perfSONAR_PS::RegularTesting::Test::run_test('perfSONAR_PS::RegularTesting::Test=HASH(0x3babd00)', 'handle_results', 'CODE(0x3cb3160)') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 50
	eval {...} called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/SelfScheduledTestChild.pm line 40
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::__ANON__('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /usr/lib64/perl5/vendor_perl/Moose/Meta/Method/Overridden.pm line 36
	perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild::child_main_loop('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master/BaseChild.pm line 32
	perfSONAR_PS::RegularTesting::Master::BaseChild::run('perfSONAR_PS::RegularTesting::Master::SelfScheduledTestChild=...') called at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/Master.pm line 182
	perfSONAR_PS::RegularTesting::Master::run('perfSONAR_PS::RegularTesting::Master=HASH(0x4581830)') called at /opt/perfsonar_ps/regular_testing/bin/daemon line 122
2015/05/14 08:07:45 (23712) WARN> daemon:103 main::__ANON__ - Warned: Use of uninitialized value in pattern match (m//) at /opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting/MeasurementArchives/EsmondBase.pm line 334.